Electronic apparatus, reproduction device, reproduction method, recording medium, and recording method

ABSTRACT

An electronic apparatus includes: an input unit that inputs data for imaging conditions for each of a plurality of imaging regions included in an image capturing unit, different imaging conditions being set for each of the imaging regions; and a recording control unit that correlates the data for imaging conditions inputted from the input unit with the imaging regions and records correlated data in a recording unit.

This is a divisional of U.S. patent application Ser. No. 15/509,572filed Jul. 18, 2017, which in turn is a U.S. National Stage ofInternational Application No. PCT/JP2015/077380 filed Sep. 28, 2015,which claims priority from Japanese Application No. 2014-201951 filed inJapan on Sep. 30, 2014. The entire contents of each of theabove-identified prior applications is incorporated by reference herein.

TECHNICAL FIELD

The present invention relates to an electronic apparatus, a reproductiondevice, a reproduction method, a recording medium, and a recordingmethod.

BACKGROUND ART

An electronic apparatus that is provided with an image sensor in whichan image capturing chip of the backside illumination type and a signalprocessing chip are laminated (hereafter, referred to as a laminatedtype image sensor) has been proposed (refer to Patent Document #1). Insuch a laminated type image sensor, the image capturing chip of thebackside illumination type and the signal processing chip are laminatedtogether so as to be connected together at each of predetermined regionsvia micro bumps.

Citation List Patent Literature

Patent Document #1: Japanese Laid-Open Patent Publication 2006-49361.

SUMMARY OF INVENTION Technical Problem

With regard to an electronic apparatus incorporating such a conventionallaminated type image sensor, there have been not so many proposals fordividing an image into one or more imaging regions each having such apredetermined region and acquiring a captured image for each imagingregion. Thus, it can be said that electronic apparatuses provided withimage sensors of the laminated type have insufficient usability.

Solution to Problem

An electronic apparatus according to a 1st aspect of the presentinvention comprises: an input unit that inputs data for imagingconditions for each of a plurality of imaging regions included in animage capturing unit, different imaging conditions being set for each ofthe imaging regions; and a recording control unit that correlates thedata for imaging conditions inputted from the input unit with theimaging regions and records correlated data in a recording unit.

According to a 2nd aspect of the present invention in the electronicapparatus according to the 1st aspect, it is preferable that the inputunit inputs image data generated by the image capturing unit; and therecording control unit correlates the image data inputted from the inputunit with the imaging regions and records correlated data in therecording unit.

According to a 3rd aspect of the present invention, in the electronicapparatus according to the 1st aspect, it is preferable that the inputunit inputs image data generated by the image capturing unit; and therecording control unit correlates the image data inputted from the inputunit with the data for the imaging conditions and records correlateddata in the recording unit.

According to a 4th aspect of the present invention, in the electronicapparatus according to any one of the 1st to 3rd aspects, it ispreferable that the input unit inputs data for information relating topositions of the imaging regions; and the recording control unitcorrelates the data for the imaging conditions inputted from the inputunit with the information relating to the positions of the imagingregions and records correlated data in the recording unit.

An electronic apparatus according to a 5th aspect of the presentinvention comprises: an input unit that inputs data for imagingconditions for each of a plurality of pixel groups included in an imagecapturing unit, each of the pixel groups including at least one pixel,and different imaging conditions being set for each of the pixel groups;and a recording control unit that correlates the imaging condition datainputted from the input unit with the pixel groups and recordscorrelated data in the recording unit.

According to a 6th aspect of the present invention, in the electronicapparatus according to the 5th aspect, it is preferable that the inputunit inputs image data generated by the image capturing unit; and therecording control unit correlates the image data inputted from the inputunit with the pixel groups and records correlated data in the recordingunit.

According to a 7th aspect of the present invention, in the electronicapparatus according to the 6th aspect, it is preferable that the imagingconditions include a first imaging condition and a second imagingcondition; the input unit inputs data for the first imaging conditionand data for the second imaging condition of the pixel groups; and therecording control unit records the data for the first imaging conditionof the pixel groups inputted from the input unit in the recording unitcorresponding to a position of the image data for each of the pixelgroups, and records the data for the second imaging condition of thepixel groups inputted from the input unit in the recording unitcorresponding to a position of the image data for each of the pixelgroups.

According to a 8th aspect of the present invention, in the electronicapparatus according to any one of the 5th to 7th aspects, it ispreferable that imaging conditions for first pixel group and secondpixel group among the plurality of pixel groups are imaging conditionsfor capturing still-images.

According to a 9th aspect of the present invention, in the electronicapparatus according to any one of the 5th to 7th aspects, it ispreferable that imaging conditions for first pixel group and secondpixel group among the plurality of pixel groups are imaging conditionsfor capturing motion-images.

According to a 10th aspect of the present invention, in the electronicapparatus according to any one of the 5th to 7th aspects, it ispreferable that an imaging condition for a first pixel group among theplurality of pixel groups is an imaging condition for motion-images andan imaging condition for a second pixel group among the plurality ofpixel groups is an imaging condition for still-images.

According to a 11th aspect of the present invention, in the electronicapparatus according to any one of the 1st to 10th aspects, it ispreferable that the data for imaging conditions contains informationrelating to exposure for capturing an image of a subject by the imagecapturing unit.

According to a 12th aspect of the present invention, in the electronicapparatus according to any one of the 1st to 11th aspects, it ispreferable that the data for imaging conditions contains informationrelating to brightness of a subject whose image is captured by the imagecapturing unit.

According to a 13th aspect of the present invention, in the electronicapparatus according to any one of the 1st to 12th aspects, it ispreferable that the data for imaging conditions contains informationrelating to an imaging operation of the image capturing unit.

According to a 14th aspect of the present invention, in the electronicapparatus according to any one of the 1st to 13th aspects, it ispreferable that the data for imaging conditions contains informationrelating to luminance of a subject whose image is captured by the imagecapturing unit.

According to a 15th aspect of the present invention, in the electronicapparatus according to any one of the 1st to 4th aspects, it ispreferable that the imaging regions each have a photoelectric conversionunit that accumulates a photoelectrically converted charge, and the datafor imaging conditions contains a time period of accumulation of chargeby the photoelectric conversion unit.

According to a 16th aspect of the present invention, in the electronicapparatus according to any one of the 1st to 15th aspects, it ispreferable that the image capturing unit has an amplification unit thatamplifies a signal generated from a photoelectrically converted chargefor each of the imaging regions; and the data for imaging conditionscontains an amplification factor of the amplification unit.

According to a 17th aspect of the present invention, in the electronicapparatus according to any one of the 2nd, 3rd, 6th, and 7th aspects, itis preferable that the recording control unit correlates maskinformation relating to use of each of the plurality of imaging regionsor of each of the plurality of pixel groups with the image data andrecords correlated data in the recording unit.

According to a 18th aspect of the present invention, in the electronicapparatus according to the 17th aspect, it is preferable that the maskinformation contains dynamic information that changes with lapse oftime.

According to a 19th aspect of the present invention, in the electronicapparatus according to the 18th aspect, it is preferable that thedynamic information is information that indicates whether the image datacontains a pixel value corresponding to a pixel signal read out from apixel belonging to the imaging regions or the pixel groups.

A reproduction device according to a 20th aspect of the presentinvention comprises: an input unit that inputs image data generated byan image capturing unit that has a plurality of imaging regions andperforms image-capturing under different imaging conditions for each ofthe imaging regions and data for the imaging conditions for each of theimaging regions; and a reproduction unit that reproduces the image databased on the data for the imaging condition corresponding to a positionof the image data inputted from the input unit.

A reproduction device according to a 21st aspect of the presentinvention comprises: an input unit that inputs image data generated byan image capturing unit that has a plurality of pixel groups eachincluding at least one pixel and performs image-capturing underdifferent imaging conditions for each of the pixel groups, and data forthe imaging conditions for each of the pixel groups; and a reproductionunit that reproduces the image data based on the data for the imagingconditions corresponding to a position of the image data inputted fromthe input unit.

A reproduction method according to a 22nd aspect of the presentinvention comprises: inputting image data generated by an imagecapturing unit that has a plurality of imaging regions and performsimage-capturing under different imaging conditions for each of theimaging regions, and data for the imaging conditions for each of theimaging regions; and reproducing the image data based on the data forthe imaging conditions corresponding to a position of the inputted imagedata.

A reproduction method according to a 23rd aspect of the presentinvention comprises: inputting image data generated by an imagecapturing unit that has a plurality of pixel groups each containing atleast one pixel and that performs image-capturing under differentimaging conditions for each of the pixel groups, and data for theimaging conditions for each of the pixel groups; and reproducing theimage data based on the data for the imaging conditions corresponding toa position of the inputted image data.

A recording medium according to a 24th aspect of the present inventionhas recorded therein image data generated by an image capturing unitthat has a plurality of imaging regions and performs image-capturingunder different imaging conditions for each of the imaging regions, anddata for the imaging conditions for each of the imaging regionscorresponding to a position of the image data.

A recording medium according to a 25th aspect of the present inventionhas recorded therein image data generated by an image capturing unitthat has a plurality of pixel groups each containing at least one pixeland performs image-capturing under different imaging conditions for eachof the pixel groups, and data for the imaging conditions for each of thepixel groups corresponding to a position of the image data.

A recording method according to a 26th aspect of the present inventioncomprises: recording image data generated by an image capturing unitthat has a plurality of imaging regions and performs image-capturingunder different imaging conditions for each of the imaging regions, anddata for the imaging conditions for each of the imaging regionscorresponding to a position of the image data.

A recording method according to a 27th aspect of the present inventioncomprises: recording image data generated by an image capturing unitthat has a plurality of pixel groups each containing at least one pixeland performs image-capturing under different imaging conditions for eachof the pixel groups, and data for the imaging conditions for each of thepixel groups corresponding to a position of the image data.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is a block diagram showing the configuration of an imagecapturing device according to a first embodiment of the presentinvention.

FIG. 2 shows plan views schematically showing the imaging surface of animage sensor.

FIG. 3 is a schematic diagram showing the configuration of an image fileaccording to an embodiment of the present invention.

FIG. 4 shows illustrative diagrams for explaining a still-image imagecapturing function A.

FIG. 5 is a diagram schematically showing the configuration of an imagefile that is generated upon performing image capturing using thestill-image image capturing function A.

FIG. 6 shows illustrative diagrams for explaining a motion-image imagecapturing function A.

FIG. 7 is a drawing schematically showing the configuration of an imagefile that is generated upon performing image capturing using themotion-image image capturing function A.

FIG. 8 shows illustrative diagrams for explaining a still-image imagecapturing function B.

FIG. 9 shows diagrams showing an example of the layout of a large group.

FIG. 10 is a diagram schematically showing the configuration of an imagefile that is generated upon performing image capturing using thestill-image image capturing function B.

FIG. 11 is an illustrative diagram for explaining a motion-image imagecapturing function B.

FIG. 12 is an illustrative diagram for explaining a motion-image imagecapturing function B.

FIG. 13 is a drawing schematically showing the configuration of an imagefile that is generated upon performing image capturing using themotion-image image capturing function B.

FIG. 14 is an illustrative diagram for explaining a mixed imagecapturing function.

FIG. 15 is a drawing schematically showing the configuration of an imagefile that is generated upon performing image capturing using the mixedimage capturing function.

FIG. 16 is a diagram schematically showing the directory structure of amemory card according to a second embodiment.

FIG. 17 shows diagrams schematically showing the structure of each fileaccording to the second embodiment.

FIG. 18 is a diagram schematically showing the structure of each fileaccording to the second embodiment.

FIG. 19 is an illustrative diagram for explaining Variation Example 2.

FIG. 20 is an illustrative diagram for explaining Variation Example 3.

FIG. 21 is an illustrative diagram for explaining Variation Example 4.

FIG. 22 is an illustrative diagram for explaining Variation Example 7.

FIG. 23 is a cross-sectional view of a laminated type image sensor.

FIG. 24 is a diagram for explaining a pixel array and a block of animage capturing chip.

FIG. 25 is a circuit diagram that corresponds to a unit of an imagecapturing chip.

FIG. 26 is a block diagram showing the functional configuration of animage sensor.

DESCRIPTION OF EMBODIMENTS First Embodiment

At first, explanation will be made on a laminated type image sensor 22to be mounted on an electronic apparatus (for instance, image capturingdevice 10) according to the present invention. This laminated type imagesensor 22 is described in Japanese Patent Application No. 2012-139026which was filed earlier by the applicant of this application. FIG. 23 isa sectional view of the laminated type image sensor 22. The image sensor22 includes a backside illumination type image capturing chip 2113 thatoutputs a pixel signal corresponding to incident light, a signalprocessing chip 2111 that processes the pixel signal, and a memory chip2112 that stores the pixel signal. These image capturing chip 2113,signal processing chip 2111, and memory chip 2112 are laminated, and areelectrically connected with each other via conductive bumps 2109 made ofCu and the like.

Note that, as illustrated, incident light is incident mainly in the Zaxis positive direction that is indicated with an outlined white arrow.In this embodiment, the surface of the image capturing chip 2113 on aside on which the incident light is incident is called a backside. Also,as indicated with coordinate axes, the leftward direction on the figurethat is orthogonal to the Z axis is referred to as the X axis positivedirection and the front side direction in the figure that is orthogonalto the Z and X axes is referred to as the Y axis positive direction. Inseveral figures mentioned below, the coordinate axes are displayed suchthat the orientation of each figure can be known on the basis of thecoordinate axes in FIG. 23.

One example of the image capturing chip 2113 is a backside illuminationtype MOS image sensor. A PD layer 2106 is arranged on the backside of aninterconnection layer 2108. The PD layer 2106 has a plurality of PDs(photo diodes) 2104 that are two-dimensionally arranged and accumulateelectrical charges according to incident light, and transistors 2105provided corresponding to the PDs 2104.

On the incident light incidence side of the PD layer 2106 are providedcolor filters 2102 via a passivation film 2103. There is a plurality oftypes of the color filters 2102 that allow passage of light beams ofmutually different wavelength ranges, and the color filters 2102 areeach arranged in a specific array corresponding to the respective PDs2104. The arrays of the color filters 2102 are described below. A set ofa color filter 2102, a PD 2104, and a transistor 2105 forms one pixel.

On the incident light incidence side of the color filter 2102 isprovided a micro lens 2101 that corresponds to each pixel. The microlens 2101 condenses incident light toward the corresponding PD 2104.

The interconnection layer 2108 has interconnections 2107 that eachtransmit a pixel signal from the PD layer 2106 to the signal processingchip 2111. The interconnection 2107 may be a multilayer, and may beprovided with a passive element and an active element.

On a front surface of the interconnection layer 2108 is arranged aplurality of the bumps 2109. These bumps 2109 are aligned with aplurality of bumps 2109 that are provided on the opposing surface of thesignal processing chip 2111, and the image capturing chip 2113 and thesignal processing chip 2111 are pressed against each other; thereby, thealigned bumps 2109 are bonded and electrically connected with eachother.

Similarly, a plurality of bumps 2109 are arranged on the mutuallyopposing surfaces of the signal processing chip 2111 and the memory chip2112. These bumps 2109 are aligned with each other, and, for example,the signal processing chip 2111 and the memory chip 2112 are pressedagainst each other; thereby, the aligned bumps 2109 are bonded andelectrically connected with each other.

Note that the bonding between the bumps 2109 is not limited to Cu bumpbonding by solid phase diffusion, but micro bump joining by soldermelting may be adopted. Also, approximately one bump 2109 may beprovided, for example, for each block described below. Accordingly, thesize of the bump 2109 may be larger than the pitch of the PDs 2104.Also, in a peripheral region other than a pixel region where pixels arearrayed, a bump that is larger than the bumps 2109 that correspond tothe pixel region may also be provided.

The signal processing chip 2111 has a TSV (through-silicon via) 2110through which circuits provided on the front side and backside,respectively, of the chip are connected. The TSV 2110 is preferablyprovided in the peripheral region. Also, the TSV 2110 may be providedalso in the peripheral region of the image capturing chip 2113 and ofthe memory chip 2112.

FIG. 24 is a figure for explaining the arrangement of pixels of theimage capturing chip 113. In particular, the figure shows a situation inwhich the image capturing chip 2113 is observed from its backsidesurface. For example, eight million pixels or more pixels are arrangedin the form of a matrix in the pixel region. In this embodiment, forinstance, four adjacent pixels in a 2×2 configuration constitute asingle block 2131. Four adjacent blocks in a 2×2 configurationconstitute a single unit group 32. Grid lines in the figure conceptuallyshow the way in which adjacent pixels are grouped to form the block 2131and the unit group 32. The number of pixels that constitute each block2131 and the number of blocks that constitute each unit group 32 are notlimited to the example described above; each of them may be greater orsmaller than it.

As illustrated in the enlarged view of a part of the pixel region, ablock 2131 includes, within its upper left, upper right, lower left, andlower right portions, four so-called Bayer arrays each consisting ofgreen pixels Gb, Gr, a blue pixel B, and a red pixel R. The green pixelsare pixels that have green filters as their color filters 2102, andreceive light of the green wavelength range in the incident light.Similarly, the blue pixels are pixels that have blue filters as theircolor filters 2102, and receive light of the blue wavelength range inthe incident light, and the red pixels are pixels that have red filtersas their color filters 2102, and receive light of the red wavelengthrange in the incident light.

In this embodiment, a plurality of blocks 2131 is defined so that atleast one group of four pixels Gb, Gr, B, and R is included in one block2131. Each of the blocks 2131 can be individually controlled withcontrol parameters that are determined separately for the four pixels inthat block 2131. In other words, image signals whose imaging conditions(or image capturing conditions) are different from each other can berespectively acquired. Examples of the control parameters include framerate, gain, sub-sampling ratio, number of rows or number of columns tobe added together, charge accumulation time, number of bits fordigitization, and so on. Furthermore, a control parameter may be aparameter for image processing after acquiring image signals from thepixels.

FIG. 25 is a circuit diagram corresponding to a single unit group 32upon the image capturing chip 2113. In FIG. 25, the representativerectangle surrounded by the dotted line shows the circuit thatcorresponds to a single pixel. Moreover, each of the rectanglessurrounded by a single dotted broken line corresponds to a single block2131. It should be understood that at least some of the transistorsexplained in the following description correspond to the transistors2105 of FIG. 23.

As described above, each of the unit groups 32 is formed from four ofthe blocks 2131. Reset transistors 2303 of the pixels included in theunit group 32 are turned ON and OFF by units of the blocks 2131.Moreover, transfer transistors 2302 of the pixels included in the unitgroup 32 are also turned ON and OFF by units of the blocks 2131. In theexample shown in FIG. 25, reset wiring 2300-1 is provided for turningthe four reset transistors 2303 corresponding to the upper left block2131-1 ON and OFF, and also TX wiring 2307-1 is provided for supplyingtransfer pulses to the four transfer transistors 2302 corresponding tothat same block 2131-1.

In a similar manner, reset wiring 2300-3, which is provided separatelyfrom the reset wiring 2300-1 described above, is provided for turningthe four reset transistors 2303 corresponding to the lower left block2131-3 ON and OFF. Moreover, TX wiring 2307-3, which is providedseparately from the TX wiring 2307-1 described above, is provided forsupplying transfer pulses to turn the four transfer transistors 2302corresponding to that same block 2131-3 ON and OFF.

In a similar manner for the upper right block 2131-2 and for the lowerright block 2131-4 as well, respective reset wiring 2300-2 and TX wiring2307-2, and reset wiring 2300-4 and TX wiring 2307-4, are providedrespectively for those blocks 2131.

The sixteen PDs 2104 corresponding to each pixel are connected to therespectively corresponding transfer transistors 2302. And transferpulses are supplied via the TX wiring for each of the blocks 2131described above to the gates of the transfer transistors 2302. The drainof each transfer transistor 2302 is connected with the source of eachcorresponding reset transistor 2303, and also a so-called floatingdiffusion FD between the drain of the transfer transistor 2302 and thesource of the reset transistor 2303 is connected with the gate of anamplifying transistor 2304.

The drains of the reset transistors 2303 are connected in common to Vddwiring 2310 to which power supply voltage is supplied. And reset pulsesare supplied via reset wiring to the gates of the reset transistors 2303of each of the blocks 2131 described above.

The drains of the amplification transistors 2304 are connected in commonto the Vdd wiring 2310, to which power supply voltage is supplied.Furthermore, the source of each of the amplification transistors 2304 isconnected to the drain of the corresponding selection transistor 2305.And decoder wiring 2308, to which selection pulses are supplied, isconnected to the gate of each of the selection transistors 2305. In thisembodiment, such decoder wiring 2308 is provided independently for eachof the sixteen selection transistors 2305. And the source of each of theselection transistors 2305 is connected to common output wiring 2309. Aload current source 2311 supplies current to the output wiring 2309. Inother words, the output wiring 2309 for the selection transistors 2305is configured according to the source follower. It should be understoodthat the load current source 2311 could be provided upon the side of theimage capturing chip 2113, or could be provided on the side of thesignal processing chip 2111.

Now, the flow from the start of accumulation of electric charge to pixeloutput after the end of that accumulation will be explained. When resetpulses are applied to the reset transistors 2303 via the reset wiring ofeach of the blocks 2131 described above, and simultaneously transferpulses are applied to the transfer transistors 2302 via the TX wiring ofeach of the blocks 2131 described above, then the electrical potentialsof the PDs 2104 and the floating diffusions FD are reset for each of theblocks 2131 described above.

When the application of a transfer pulse to each of the PDs 2104 iscanceled, the received light that is incident thereupon starts to beconverted into electric change, which is accumulated. Thereafter, when atransfer pulse is applied again in the state in which no reset pulse isbeing applied, the accumulated electric charge is transferred to thefloating diffusion FD, and the electrical potential of the floatingdiffusion FD becomes a signal electrical potential after chargeaccumulation from the reset electrical potential. And, when a selectionpulse is applied to the selection transistor 2305 via the decoder wiring2308, fluctuation of the signal electrical potential of the floatingdiffusion FD is transmitted to the output wiring 2309 via theamplification transistor 2304 and the selection transistor 2305. Due tothis, a pixel signal corresponding to the reset electrical potential andto the signal electrical potential is outputted from the unit pixel tothe output wiring 2309.

As described above, in this embodiment, reset wiring and TX wiring areprovided in common for each of the four pixels that make up each of theblocks 2131. In other words, each reset pulse and each transfer pulse isapplied simultaneously to all of the four pixels within the same block2131. Accordingly, all of the pixels that make up one of the blocks 2131start accumulation of electric charge at the same timing, and endaccumulation of electric charge at the same timing. However, byselection pulses being applied in sequence to the respective selectiontransistors 2305, the pixel signals corresponding to the accumulatedelectric charges are selectively outputted from the output wiring 2309.

In this manner, in this embodiment, it is possible to control the timingof the start of charge accumulation for each of the blocks 2131individually. To put it in another manner, it is possible to captureimages at different timings for different ones of the blocks 2131.

FIG. 26 is a block diagram showing the functional structure of the imagesensor 22. An analog multiplexer 2411 selects the sixteen PDs 2104 thatmake up a unit group 32 in order, and outputs the respective pixelsignals to the output wiring 2309 that is provided to correspond to thatunit group 32. This multiplexer 2411 is formed upon the image capturingchip 2113, along with the PDs 2104.

The pixel signals outputted via the multiplexer 2411 are subjected tocorrelated double sampling (CDS) and analog/digital (A/D) conversion bya signal processing circuit 2412 that is formed upon the signalprocessing chip 2111, and that performs correlated double sampling (CDS)and analog/digital (A/D) conversion. The pixel signals that have thusbeen A/D converted are transferred to a demultiplexer 2413, and arestored in pixel memories 2414 corresponding to the respective pixels.The demultiplexer 2413 and the pixel memories 2414 are formed upon thememory chip 2112.

After the calculation circuit 2415 processes the pixel signals stored inthe pixel memories 2414, it transfers them to a subsequent stage imageprocessing unit. The calculation circuit 2415 may be provided upon thesignal processing chip 2111, or may be provided upon the memory chip2112. It should be understood that while, in FIG. 26, the connectionsfor a single unit group 32 are shown, actually these are provided foreach of the unit groups 32, and operate in parallel. However, it will beacceptable for an individual calculation circuit 2415 not to be providedfor each unit group 32; for example, it would also be acceptable toarrange for a single calculation circuit 2415 to perform sequentialprocessing while referring to the values in the pixel memories 2414corresponding to each unit group 32 in order.

As described above, output wiring 2309 is provided corresponding to eachof the unit groups 32. Since, in the image sensor 22, the imagecapturing chip 2113, the signal processing chip 2111, and the memorychip 2112 are laminated together, accordingly, by electricallyconnecting between the chips by using the bumps 2109 in this outputwiring 2309, it is possible to route the wiring without making the chipslarger in the surface direction.

FIG. 1 is a block diagram showing the configuration of an imagecapturing device according to a first embodiment of the presentinvention. An image capturing device 10 is a lens-integrated typecamera. The image capturing device 10 includes an image capturingoptical system 21, an image sensor 22, a control unit 23, a liquidcrystal monitor 24, a memory card 25, an actuation unit 26, a DRAM 27, aflash memory 28, and a recording unit 29.

The image capturing optical system 21 is constituted by a plurality oflenses and forms a subject image upon an imaging surface of the imagesensor 22. Note that in FIG. 1, the image capturing optical system 21 isshown as a single lens.

The image sensor 22 is an image sensor such as, for instance, CMOS orCCD, which picks up a subject image that is formed by the imagecapturing optical system 21 and outputs an imaging signal. The controlunit 23, which is an electronic circuit that controls each unit of theimage capturing device 10, includes a CPU and its peripheral circuit.The flash memory 28, which is a nonvolatile recording medium, haswritten therein a predetermined control program in advance. The controlunit 23 reads the control program from the flash memory 28 and executesit to thereby control each unit. This control program uses the DRAM 27,which is a volatile recording medium, as a workspace.

The liquid crystal monitor 24 is a display device that has a liquidcrystal panel. The control unit 23 allows the image sensor 22 to pick upa subject image repeatedly at a predetermined cycle (for instance, 1/60second). Then, the image signal outputted from the image sensor 22 issubjected to various types of image processing to generate a so-calledthrough-image or live view image, which is displayed on the liquidcrystal monitor 24. On the liquid crystal monitor 24 is displayed, forinstance, a setting screen, on which imaging parameters (imagingconditions) are to be set, as well as the through-image.

The control unit 23 generates an image file as described below based onan imaging signal that is outputted from the image sensor 22 and recordsthe image file in the memory card 25, which is a portable recordingmedium. The actuation unit 26 has various types of actuation members,such as push buttons, and outputs actuation signals to the control unit23 in response to the actuation of the actuation members. The recordingunit 29, which is constituted by, for instance, a microphone, convertsenvironmental sound into audio signal and inputs the audio signal intothe control unit 23. Note that the image file 40 does not have to berecorded in the memory card 25 which is a portable recording medium, butmay be recorded in a hard disk drive which is a recording medium, notshown in the figures, built-in in the image capturing device 10.

FIG. 2(a) is a plan view schematically showing an imaging surface 30 ofthe image sensor 22. FIG. 2(b) is a plan view showing a partial region30 a of the imaging surface 30 in an enlarged scale. As shown in FIG.2(b), a large number of imaging pixels 31 are arranged two-dimensionallyon the imaging surface 30. The imaging pixels 31 have each a colorfilter, not shown in the figures. The color filters are of the threetypes, red (R), green (G), and blue (B) filters. In FIG. 2(b), notations“R”, “G”, and “B” represent the types of the color filters that theimaging pixels 31 have. As shown in FIG. 2(b), the imaging pixels 31that have color filters of these types are arranged on the imagingsurface 30 of the image sensor 22 according to a so-called Bayer array.

The imaging pixels 31 that have red filters photoelectrically convertlight, among the incident light, of the red wavelength range into lightreception signals (i.e., photoelectrical conversion signals) and outputthem. Similarly, the imaging pixels 31 that have green filtersphotoelectrically convert light, among the incident light, of the greenwavelength range into light reception signals and output them. Theimaging pixels 31 that have blue filters photoelectrically convertlight, among the incident light, of the blue wavelength range into lightreception signals and output them.

The image sensor 22 according to this embodiment is configured so as toenable its control for each of the unit group 32 made up from the fouradjacent imaging pixels 31 in a 2×2 configuration, individually. Withthis configuration, it is possible to perform, when charge accumulationhas started in, for instance, two mutually different unit groups 32,simultaneously, for one unit group 32, reading out of the charge, i.e.,reading out of the light reception signals after 1/30 second from thestart of the charge accumulation, while for the other unit group 32,reading out of the charge after 1/15 second after the start of thecharge accumulation. In other words, it is possible to set at the imagesensor 22 different exposure times (i.e., charge accumulation times,which are so-called shutter speeds) for each unit group 32 in a singleimaging operation.

In addition to the above-described exposure time, it is also possible toset at the image sensor 22 different amplification factors of imagingsignal (i.e., so-called ISO sensitivities) for different unit groups 32.The image sensor 22 can change timing at which charge accumulation isstarted and timing at which a light reception signal is read out foreach unit group 32. That is, the image sensor 22 can change the framerate upon image capturing a motion-image for each unit group 32.

When taken together, the image sensor 22 is configured to set exposuretimes, amplification factors, frame rates, and so on that are differentfor different unit groups 32, respectively. For instance, if aconfiguration is adopted in which a read out line, not shown in thefigures, for reading out an imaging signal from a photoelectricconversion unit, not shown in the figures, of an imaging pixel 31 isprovided at each unit group 32 such that an imaging signal can be readout from each unit group 32 independently of each other, differentexposure times (shutter speeds) can be set for different unit groups 32,respectively. Also, if a configuration is adopted in which anamplification circuit, not shown in the figures, for amplifying animaging signal generated with a photoelectrically converted charge isprovided at each unit group 32 independently of each other such that theamplification factors of amplification circuits can be controlled foreach amplification circuit, the amplification factors (ISO sensitivity)can be changed for each unit group 32, separately.

Note that the number of the imaging pixels 31 that constitute the unitgroup 32 is not limited to the above-mentioned four pixels in a 2×2configuration. The unit group 32 may have at least one imaging pixel 31and conversely may have more than four imaging pixels 31. The imagingconditions that can be set separately for different unit groups 32 maybe those conditions other than the above-described ones. For instance,if a configuration is adopted in which the image sensor 22 is providedwith a liquid crystal panel that has sections (of which one sectioncorresponds to one unit group 32) such that they can be controlled foreach unit group 32 independently of each other and such configuration isused as a neutral density filter that can be turned on/off, it ispossible to control brightness (i.e., aperture value) for each unitgroup 32.

Then, the image file 40 that is generated and recorded in the memorycard 25 by the control unit 23 will be described below. FIG. 3 is aschematic diagram showing a configuration of the image file according tothe embodiment of the present invention. The image file 40 isconstituted by two blocks, i.e., a header section 41 and a data section42.

The header section 41 is a block that is arranged on the head of theimage file 40, in which file basic information section 43, a masksection 44, and an imaging information section 45 are stored in theorder as described above. In the file basic information section 43, forinstance, size and offset of each of the sections in the image file 40(i.e., the header section 41, the data section 42, the mask section 44,the imaging information section 45 and so on) are recorded. In the masksection 44, imaging condition information, mask information and so on,which are described later, will be recorded. In the imaging informationsection 45, for instance, information about image capturing, such asmodel name of the image capturing device 10 and information about theimage capturing optical system 21 (for instance, information about theoptical property, such as aberration) will be recorded. In the datasection 42, which is a block placed behind the header section 41, isrecorded image information, audio information, and the like.

Then, explanation is made on image capturing functions that the imagecapturing device 10 has and on the image file 40 that is generated(recorded) by each image capturing function. The user can performpredetermined actuation to the actuation member of the actuation unit 26to enable switching (selecting) each image capturing function asdescribed below. The control unit 23 performs image capturing based onthe selected image capturing function to generate the image file 40 andrecord it in the memory card 25.

(1) Still-Image Image Capturing Function A (Single Still-Image)

A still-image image capturing function A is a function to divide animage capture screen into a plurality of partial regions and setrespective imaging conditions for the plurality of partial regionsseparately to allow image capturing of a still-image.

FIG. 4(a) schematically shows an image capture screen 50 (an imagingrange of the image sensor 22) and a subject 51. A procedure via which animage of the subject 51 that is shown in FIG. 4(a) is captured isexplained. The control unit 23 takes an image of the subject 51 beforemain image capturing is performed. Hereafter, image capturing that isperformed prior to main image capturing is referred to as preliminaryimage capturing. Note that the preliminary image capturing may also beperformed as image capturing for generating a live view image (so-calledthrough-image).

The control unit 23 executes predetermined image analysis processing onthe image of the subject 51 acquired by preliminary image capturing(i.e., image in which the subject 51 comes out). The image analysisprocessing is a processing that detects a main subject part and abackground part by using, for instance, a known subject detectiontechnology (which is a technology that detects a range in which apredetermined subject is present by calculating an amount ofcharacteristic). The image analysis processing achieves division of theimage capture screen 50 into a main subject region 52 in which a mainsubject part is present and a background region 53 in which a backgroundpart is present.

Note that in FIG. 4(a), a region that roughly includes the subject 51 isshown as the main subject region 52. However, the main subject region 52may have a shape along an outline of the subject 51. That is, the mainsubject region 52 may be set so as to exclude things other than thesubject 51 as much as possible.

The control unit 23 sets different imaging conditions for the unitgroups 32 in the main subject region 52 and for the unit groups 32 inthe background region 53. For instance, the control unit 23 may set afaster shutter speed for the former unit groups 32 than for the latterunit groups 32. With this setting, image blurring becomes difficult tooccur in the main subject region 52 upon the main image capturing.

If the main subject region 52 is in a backlight state under theinfluence of a light source such as the sun that is present in thebackground region 53, the control unit 23 may set a relatively high ISOsensitivity or a relatively low shutter speed for the former unit groups32. Also, the control unit 23 may set a relatively low ISO sensitivityor a relatively high shutter speed for the latter unit groups 32. Withthis setting, blocked up shadows in the main subject region 52 in abacklight state and blown out highlights of the background region 53that receives a large amount of light can be prevented upon the mainimage capturing.

Note that the image analysis processing may be different from theprocessing that detects the above-mentioned main subject part andbackground part. For instance, it may be a processing that detects,among the whole image capture screen 50, a part having brightness equalto or higher than a predetermined value (too bright a part) and a parthaving brightness below a predetermined value (too dark a part). If theimage analysis processing is such a processing, the control unit 23 mayset a shutter speed and ISO sensitivity such that the unit groups 32included in the former region can have an exposure value (Ev value)lower than that of the unit groups 32 in any other regions. On the otherhand, the control unit 23 sets a shutter speed and ISO sensitivity suchthat the unit groups 32 included in the latter region can have anexposure value (Ev value) higher than those for the unit groups 32included in any other regions. With this setting, the dynamic range ofthe image acquired by the main image capturing can be made broader thanthe original dynamic range of the image sensor 22.

FIG. 5 is a diagram schematically showing a configuration of the imagefile 40 that is generated in case image capturing is performed by usingthe still-image image capturing function A. In the mask section 44 arerecorded distinction information 60, imaging condition information 61and mask information 62 a in the above-described order. The distinctioninformation 60 is information that indicates to the effect that thisimage file 40 is generated by using the still-image image capturingfunction A.

The imaging condition information 61 is information that indicates whatuses (objects, roles) the unit groups 32 have. For instance, in casethat the image capture screen 50 (FIG. 4(a)) is divided into the mainsubject region 52 and the background region 53 as described above, eachof the unit groups 32 belongs to either the main subject region 52 orthe background region 53. That is, each unit group 32 have either a useof performing “still-image image capturing of a main subject part” or ause of performing “still-image image capturing of a background part”.The imaging condition information 61 is information that indicates thatupon generation of this image file 40, the unit groups 32 have two typesof uses, one for “still-image image capturing of a main subject part”and the other for “still-image image capturing of a background part” andthat represents respective unique numbers allotted to these uses. Forinstance, the number 1 is allotted to the use of “still-image imagecapturing of a main subject part” and the number 2 is allotted to theuse of “still-image image capturing of a background part”.

The mask information 62 a is information that represents uses (objects,roles) of the respective unit groups 32. In this embodiment, the maskinformation 62 a is defined as information “expressed in the form of atwo-dimensional map in which numbers allotted to the imaging conditioninformation 61 are plotted in accordance with the positions of the unitgroups 32”. That is, when the unit groups 32 that are arrangedtwo-dimensionally are identified by a two-dimensional coordinate ((x,y)) with two integers x and y, the unit group 32 that is present at theposition of ((x, y)) has a use that is expressed by the number that ispresent at the position of ((x, y)) of the mask information 62 a. Forinstance, when the number “1” is found to be present at the position ofcoordinate (3, 5) of the mask information 62 a, it is found that theunit group 32 arranged at the coordinate (3, 5) is given a use of“still-image image capturing of a main subject part”. In other words, itis found that the unit group 32 arranged at the coordinate (3, 5)belongs to the main subject region 52.

An example of the mask information 62 a that corresponds to the imagecapture screen 50 as shown in FIG. 4(a) is shown in FIG. 4(b). At thepositions of the unit groups 32 that belong to the main subject region52, “1” is stored. Also, at the positions of the unit groups 32 thatbelong to the background region 53, “2” is stored.

In the data section 42 are stored mask information 62 b, imageinformation 64, a Tv value map 65, a Sv value map 66, a By value map 67,and an Av value information 68 in the above-described order. The maskinformation 62 b is the same information as the mask information 62 athat is stored in the mask section 44. Here, the reason that the samemask information 62 a, 62 b is stored in both the mask section 44 andthe data section 42 is to make it easy to handle the image file 40.

Although details is described later, pieces of mask information 62 a, 62b that are different from each other may be stored in the mask section44 and in the data section 42, respectively, in the case of the imagefile 40 that is generated by another function. If, for instance, themask information 62 b is stored in the data section 42 and no maskinformation 62 a is stored in the mask section 44 in the still-imageimage capturing function A, the structure of the image file 40 changesdepending on the functions. This configuration makes it cumbersome andcomplicated to handle the image file 40. Accordingly, in thisembodiment, the same pieces of mask information 62 a, 62 b are stored inboth the mask section 44 and the data section 42 purposely to minimize adifference in structure of the image file 40 for each of the functions.Note that either one of pieces of the mask information 62 a, 62 b may beomitted. If omitted, the size of the storage region occupied by theimage file 40 can be reduced. Even if both the pieces of maskinformation 62 a, 62 b are recorded, it can be determined whether it isnecessary to read in both the pieces of mask information 62 a, 62 bbased on distinction information. Thus, if it is determined that one ofthem is unnecessary for a reproduction process and so on, then readingin of such one may be skipped to shorten file read-in time.

Note that in the explanation below, the mask information 62 a that isstored in the mask section 44 and the mask information 62 b that isstored in the data section 42 are collectively called mask information62.

The image information 64 is information that is generated by recordingimaging signals that are output from the image sensor 22 upon main imagecapturing before they are subjected to various types of imageprocessing. This information is so-called RAW image data. The Tv valuemap 65 is information that is expressed in the form of a two-dimensionalmap generated by plotting Tv values representing shutter speeds that areset for respective unit groups 32 in accordance with the positions ofthe unit groups 32. For instance, the shutter speed that is set for theunit group 32 arranged at the coordinate (x, y) can be determined bychecking the Tv value stored at the coordinate (x, y) in the Tv valuemap 65.

The Sv value map 66 is information that is expressed in the form of atwo-dimensional map generated by plotting Sv value representing ISOsensitivity that is set for each of the unit groups 32 in the samemanner as that in the case of the Tv value map 65. The By value map 67is information that is expressed in the form of a two-dimensional mapgenerated by plotting luminance of the subject that is measured for eachof the unit groups 32 upon main image capturing. That is, it isinformation that is expressed in the same form as the Tv value map 65 byplotting By values representing luminance of subject light incident ineach of the unit groups 32. The Av value information 68 is informationthat represents aperture value upon main image capturing. In thisembodiment, Av values, which are different from the Tv values, the Svvalues, and the By values, are not present for each of the unit groups32 separately. Therefore, unlike the Tv value, Sv value, and By value,only a single value is stored for the Av value, so that it is differentfrom the information that is formed by two-dimensionally mapping aplurality of values.

As described above, the control unit 23 performs image capturing byusing the still-image image capturing function A and thereby records inthe memory card 25 the image file 40 in which the image information 64that is generated by the image sensor 22 capable of setting respectiveimaging conditions for the unit groups 32 are correlated with datarelating to the respective imaging conditions for the unit groups 32(i.e., the imaging condition information 61, the mask information 62,the Tv value map 65, the Sv value map 66, and the By value map 67 and soon).

Note that in the above explanation, the image information 64 isexplained as being RAW image data. However, it need not be RAW imagedata but may be compressed (developed) image data.

(2) Motion-Image Image Capturing Function A (Single Motion-Image)

The motion-image image capturing function A is a function according towhich the image capture screen is separated into a plurality of partialregions and imaging conditions are set therefor individually to performimaging of a motion-image. The motion-image image capturing function Adiffers from the still-image image capturing function A in that theformer performs image capturing of a motion-image but not a still-image.To perform image capturing of a motion-image instead of a still-image,there is the possibility that “uses of respective unit groups 32”described regarding the still-image image capturing function A may bechanged frame by frame.

FIG. 6(a) schematically shows the image capture screen 50 (imagingrange) of the image sensor 22 and the subject 51. The control unit 23performs preliminary image capturing prior to main image capturing.Then, the control unit 23 executes predetermined image analysisprocesses on the image of the subject 51 (image in which the subject 51comes out) acquired by the preliminary image capturing. By the imageanalysis processes, the image capture screen 50 is divided into a mainsubject region 52 in which a main subject part is present and abackground region 53 in which a background part is present. The controlunit 23 sets imaging conditions different from each other for the unitgroups 32 in the main subject region 52 and for the unit groups 32 inthe background region 53 and performs main image capturing for a firstframe to generate image data. An example of mask information 62 in thiscase is shown in FIG. 6(b). In the mask information 62 shown in FIG.6(b), for example, the number “1” is allotted to the unit groups 32belonging to the main subject region 52 and the number “2” is allottedto the unit groups 32 belonging to the background region 53.

Then, the control unit 23 performs image analysis processes on the firstframe image data to detect a main subject part and a background part. Asa result, the first frame image data is divided into the main subjectregion 52 and the background region 53 as shown in FIG. 6(c). Thecontrol unit 23 sets imaging conditions that are different from eachother for the unit groups 32 in the main subject region 52 and for theunit groups 32 in the background region 53 and performs a second framemain image capturing to generate image data. An example of the maskinformation 62 in this case is shown in FIG. 6(d).

Comparing the mask information 62 (FIG. 6(b)) corresponding to theresult of the preliminary image capturing with the mask information 62(FIG. 6(d)) corresponding to the result of the first frame main imagecapturing, these two pieces of mask information 62 may sometimes havecontents different from each other in case, for instance, the subject 51is moving or the user moves the image capturing device 10 becauseimaging is performed at different times (i.e., because of presence oftime lag). In other words, the mask information 62 is dynamicinformation that varies with lapse of time. Therefore, in some of theunit groups 32, imaging conditions that are different from each otherwill be set at the times of the first frame main image capturing and thesecond frame main image capturing.

The control unit 23 records, in the image file 40, the mask information62 b, the Tv value map 65, the Sv value map 66, the By value map 67, andthe Av value information 68 for each frame as well as the imageinformation 64 for each frame. Therefore, after image capturing, all theinformation upon image capturing can be acquired from the image file 40and utilized effectively in reproduction of motion-images.

Note that the processes upon third and subsequent frames main imagecapturing are the same as the processes for the second frame andexplanation thereof will be omitted here. The control unit 23 repeatedlyperform the above-mentioned processes until image capturing is completed(for instance, until a predetermined time is elapsed or until the userperforms a predetermined imaging termination actuation).

FIG. 7 is a diagram schematically showing a configuration of the imagefile 40 that is generated when image capturing is performed by using themotion-image image capturing function A. Hereafter, differences fromimage capturing by using the still-image image capturing function A asshown in FIG. 5 will be described in detail.

The distinction information 60 indicates that the image file 40 isgenerated by using the motion-image image capturing function A. Theimaging condition information 61 corresponds to the imaging conditioninformation 61 upon imaging by using the still-image image capturingfunction A plus a frame rate. That is, the imaging condition information61 is information that indicates that upon generation of the image file40, the unit groups 32 have two types of uses, for instance, one forperforming “motion-image image capturing of a main subject part at 60fps” and the other for performing “motion-image image capturing of abackground part at 30 fps” and that represents unique numbers allottedto the respective uses. For instance, the number “1” is allotted to theuse of performing “motion-image image capturing of a main subject partat 60 fps” and the number “2” is allotted to the use of performing“motion-image image capturing of a background part at 30 fps”.

The mask information 62 a is information similar to that upon imagecapturing by using the above-mentioned still-image image capturingfunction A. However, upon the motion-image image capturing, the maskinformation 62, which is dynamic information that varies frame by frame,need be determined as to which frame is to be selected for recording itsmask information 62 in the header section 41. In this embodiment, themask information 62 a representing respective imaging conditions thatare set for the unit groups 32 at the first frame image capturing, thatis, the mask information 62 that is shown as an example in FIG. 6(b) arerecorded in the header section 41. This configuration is adopted toprevent handling of the image file 40 from becoming cumbersome andcomplicated as described in the explanation of the still-image imagecapturing function A.

In the data section 42, a block 70 for one frame quota is stored foreach frame in the order of image capturing. A single block 70 includesthe mask information 62, the image information 64, the Tv value map 65,the Sv value map 66, the By value map 67, and the Av value information68. In the data section 42, audio information 71 is stored together withthe respective blocks 70 for the frames. To enable easy motion-imagereproduction, the audio information 71 is divided into a plurality ofpieces of information each containing information for one frame quota,each of which pieces is multiplexed with a corresponding block 70 beforethe divided and multiplexed pieces of information can be stored in thedata section 42. Note that multiplexing of the audio information 71 maybe performed for every predetermined number of frame quotas instead ofone frame quota. Each of the pieces of information in the block 70 isrecorded frame by frame. Except for this, the image capturing by usingthe motion-image image capturing A is the same as the image capturing byusing the still-image image capturing function A and further explanationis omitted.

As described above, the control unit 23 performs image capturing byusing the motion-image image capturing function A to thereby record, inthe memory card 25, the image file 40 in which the image information 64that is generated by the image sensor 22 for which imaging conditionsfor each of the unit groups 32 can be set and data relating to imagingconditions (imaging condition information 61, mask information 62, Tvvalue map 65, Sv value map 66, and By value map 67 and so on) for eachof the unit groups 32 are correlated with each other.

(3) Still-Image Image Capturing Function B (a Plurality of Still-Images)

The still-image image capturing function B is a function ofsimultaneously image capturing a plurality of still-images relating tothe same subject under imaging conditions differing from each other bysingle image capturing operation.

FIG. 8(a) schematically shows an imaging surface 30 of the image sensor22. On the other hand, FIG. 8(b) is a schematic diagram showing apartial region 30 b of the imaging surface 30 in an enlarged view. Inthe case of the still-image image capturing function B, a plurality ofunit groups 32 arranged in a two-dimensional array are furtherclassified into a plurality of large groups 81. On this occasion, theunit groups 32 are classified such that unit groups 32 that belong toany one of the large groups 81 are arranged uniformly over all theimaging surface 80. For instance, in FIG. 8(b), all the unit groups 32are divided into blocks 82, each of which includes 4 unit groups 32arranged in a 2×2 configuration; in each block 82, the upper left unitgroup 32 is classified into a first large group 811, the lower left unitgroup 32 is classified into a second large group 812, the upper rightunit group 32 is classified into a third large group 813, and the lowerright unit group 32 is classified into a fourth large group 814. Notethat in FIG. 8(b), one schematically shown square represents a singleunit group 32. The number described in the square represents the kind ofthe large group 81 to which that unit group 32 belongs.

Upon main image capturing, the control unit 23 sets respective imagingconditions that differ from each other for the unit groups 32 thatbelong to the first large group 811, the unit groups 32 that belong tothe second large group 812, the unit groups 32 that belong to the thirdlarge group 813, and the unit groups 32 that belong to the fourth largegroup 814. For instance, the control unit 23 performs main imagecapturing with the shutter speed and ISO sensitivity set to valuesdiffering from each other. The control unit 23 records the imageinformation acquired by performing image capturing in this manner in theimage file 40. Here, the recorded image information is intended suchthat each pixel value is aggregated for each of the large groups 81 forfurther use as schematically shown in FIG. 8(c).

For instance, as shown in FIG. 8(c), when only those pixel values thatcorrespond to the unit groups 32 belonging to the first large group 811are extracted from the image information 64 and arranged in atwo-dimensional array, first image information 641 consisting of anumber of pixel values, which number is ¼ times the number of pixels ofthe image sensor 22, is obtained. Similarly, when only those pixelvalues that correspond to the unit group 32 belonging to the secondlarge group 81 are extracted from the image information 64 and arrangedin a two-dimensional array, second image information 642 is obtained,which consists of a number of pixel values, which number is ¼ times thenumber of pixels of the image sensor 22 and in which the same subject 51as that in the first image information 641 whose image has been capturedunder imaging conditions different from the above-mentioned first imageinformation 641 comes out. Similarly, third image information 643 andfourth image information 644 are obtained. These four pieces of imageinformation 641, 642, 643, and 644 are images obtained by imagecapturing the same subject 51 under imaging conditions differing fromeach other. That is, as mentioned first, a single imaging operationachieves simultaneous imaging of four still-images regarding the samesubject 51 under imaging conditions differing from each other.

Note that the image information 64 in the image file 40 is an imageobtained by arranging pixels output from respective imaging pixels 31just according to the positions of the imaging pixels 31. That is, theprocesses for generating the above-mentioned four pieces of imageinformation 641, 642, 643, and 644 are performed upon reproduction inwhich the image file 40 is read out from the memory card 25 or upondevelopment. Furthermore, the image information 64 is not necessarilyintended to be used only for generating the four pieces of imageinformation 641, 642, 643, and 644. If the image information 64 is used(reproduced, etc.) as it is, without generation of a plurality of piecesof divided information, then, for instance, a checkerboard pattern comesout in the resultant image to make the image unnatural due to imagingconditions that differ from each of the adjacent unit groups 32,respectively. However, since respective imaging conditions (forinstance, Tv value, Sv value, etc.) for each of the unit groups 32 arerecorded in the image file 40, development by combining such imagingconditions with the image information 64 enables generation of suchunnatural images to be prevented. For instance, for the unit groups 32that have an exposure value (Ev value) higher than other unit groups 32,development may be performed at a luminance that is lower than otherunit groups 32.

The example in which the unit groups 32 are classified into four largegroups 811, 812, 813, and 814 has been explained above. However, the wayof classifying the unit groups 32 is not limited to four large groupsbut the unit groups 32 may be classified into any desired number oflarge groups 81 to enable simultaneous image capturing of any desirednumber of still-images. Furthermore, the layout of large groups 81(method of classifying the unit groups 32) is not limited to classifyingthe unit groups 32 in a 2×2 configuration into different large groups81, respectively, one by one.

In this regard, some examples are shown in FIGS. 9(a), and 9(b). In FIG.9(a), all the unit groups 32 are separated into any of sets includingnine unit groups in a 3×3 configuration and nine unit groups 32 includedin each of the sets are allotted to first to ninth large groups 81,respectively. By adopting this layout, simultaneous image capturing ofnine images 641 to 649 under mutually different imaging conditions canbe achieved by a single imaging operation. On the other hand, in FIG.9(b), all the unit groups 32 are separated any of sets including nineunit groups in a 3×3 configuration and in each of the sets, the unitgroup 32 at the upper left corner is allotted to the first large group81, and four unit groups 32 in a 2×2 configuration at the lower rightare allotted to the second large group 81. In this layout, the rest fourunit groups 32 are not used in image capturing. With this configuration,a single image capturing operation enables simultaneous imaging of twoimages 641, 642 under different imaging conditions, with the image 642corresponding to the second large group 81 having a pixel number that is4 times as large as the image 641 corresponding to the first large group81. That is, a single imaging operation enables simultaneous imaging oftwo images 641, 642 under different imaging conditions, with the twoimages 641, 642 having mutually different pixel numbers.

FIG. 10 is a diagram schematically showing a configuration of the imagefile 40 that is generated upon imaging by using the still-image imagecapturing function B. Hereafter, differences of the still-image imagecapturing function B from the still-image image capturing function Awill be described in detail.

The distinction information 60 indicates that the image file 40 isgenerated by using the still-image image capturing function B. Theimaging condition information 61 is information that indicates which usethe unit group 32 has. In the case of the still-image image capturingfunction B, each unit group 32 has any one of uses, for instance, a useof “configuring the first image information 641”, a use of “configuringthe second image information 642”, a use of “configuring the third imageinformation 643”, and a use of “configuring the fourth image information644”. The imaging condition information 61 is information that indicatesthat upon generating this image file 40, these four kinds of uses arepresent in the unit groups 32 and that represents unique numbersallotted to the respective uses. For instance, numbers 1 to 4 areallotted to uses of “configuring first to fourth image information 641to 644”, respectively.

In the case of the still-image image capturing function B, the maskinformation 62 a is information represents a use of each of the unitgroups 32 in the same manner as that in the case of the still-imageimage capturing function A. That is, the mask information 62 a is“information expressed in the form of a two-dimensional map that isgenerated by plotting the numbers allotted to the imaging conditioninformation 61 in accordance with the position of each unit group 32”.For instance, when the number “1” is present at the coordinate (3, 5) ofthe mask information 62 a, the unit group 32 at the coordinate (3, 5)belongs to the first large group 811, that is, constitutes the firstimage information 641.

Note that in this embodiment, the large group 81 that has a number of“0” is a special large group 81 that represents a unit group 32 that isnot used in image capturing. That is, in the mask information 62 a theunit groups 32 to which the number “0” is allotted are not used in imagecapturing (i.e., no imaging signal is read out upon main imagecapturing) and no information about the unit groups 32 is included inthe image information 64 that is recorded in the data section 42 (ordummy information which is ineffective is recorded as information aboutthe unit groups 32).

For instance, in case that simultaneous image capturing under threekinds of different imaging conditions is sufficient and simultaneousimage capturing under four kinds of different imaging conditions isunnecessary, the number “0” will be allotted to the mask information 62a of the unit groups 32 to which “4” is allotted among the unit groups32 shown in FIG. 8(b).

The structure of the data section 42 is the same as that of the datasection 42 in image capturing by using the still-image image capturingfunction A. That is, in the data section 42 are stored the maskinformation 62 b, the image information 64, the Tv value map 65, the Svvalue map 66, the By value map 67, and the Av value information 68. Themask information 62 b is the same information as the mask information 62a that is stored in the mask section 44.

Note that information that represents validity/invalidity of each of theunit groups 32 may be stored as the mask information 62 b instead of theinformation that is the same as the mask information 62 a of the masksection 44. For instance, a map generated by allotting a numerical valueof “0” to the unit groups 32 that are not used in image capturing (i.e.,from which no imaging signal is read out upon image capturing) and anumerical value of “1” to the unit groups 32 that are used in imagecapturing (i.e., from which an imaging signal is read out upon imagecapturing) and arranging these numerical values in the form of atwo-dimensional array may be stored in the data section 42 as the maskinformation 62 b. The same is true for image capturing by using amotion-image image capturing function B or a mixed image capturingfunction as described later.

As described above, the control unit 23 performs imaging by using thestill-image image capturing function B to record, in the memory card 25,the image file 40 in which the image information 64 generated by theimage sensor 22 for which imaging conditions can be set for each of theunit groups 32 separately is correlated with data relating to theimaging conditions (the imaging condition information 61, the maskinformation 62, the Tv value map 65, the Sv value map 66, the By valuemap 67, etc.) for each of the unit groups 32.

(4) Motion-Image Image Capturing Function B (a Plurality ofMotion-Images)

The motion-image image capturing function B is a function that performssimultaneous imaging of motion-images relating to the same subject by asingle imaging operation under mutually different imaging conditions.The motion-image image capturing function B differs from the still-imageimage capturing function B in that according to the former,motion-images are captured instead of still-images. Although themotion-image image capturing function B is a function of capturingmotion-images, some unit groups 32 that are classified into a certainlarge group 81 are not classified into different large groups 81 frameby frame as in the motion-image image capturing function A. However,depending on the setting of frame rates, it may happen that the unitgroup 32 that is included in one frame (i.e., that is valid in oneframe) is not included in another frame (i.e., is invalid in anotherframe). Hereafter, the motion-image image capturing function B will beexplained based on the setting of frame rate.

(4-1) When Frame Rates are Unified in all the Large Groups 81

FIG. 11 is an illustrative diagram of the motion-image image capturingfunction B when frame rates are the same in all the large groups 81. Inthis case, the imaging conditions that differ for each of the largegroups 81 means imaging conditions other than frame rate (for instance,shutter speed, ISO sensitivity, etc.). Even if the exposure time isdifferent for each of the large groups 81, the frame rate, i.e., theperiod at which signals are read out, is the same. Hence in all thelarge groups 81, reading out of imaging signals is performed at apredetermined cycle T1 that corresponds to the frame rate.

Since imaging is performed at the same frame rate in all the unit groups32, all the unit groups 32 are used in image capturing for all theframes. In other words, in all the frames, an imaging signal is read outfrom all the unit groups 32 and the imaging signals that are read outfrom all the unit groups 32 are included in pieces of the imageinformation 64 of all the frames, respectively. For instance, firstimage information 64 is generated at time t1, which is by apredetermined period T1 later than an image capturing start time t0. Theimage information 64 includes an image of a first frame in the firstlarge group 81 (i.e., the frame indicated with #1 in FIG. 11, hereafter,the same), an image of the first frame in the second large group 81, animage of the first frame in the third large group 81, and an image ofthe first frame in the fourth large group 81. The same is true for thesecond and subsequent pieces of image information 64.

(4-2) When Frame Rates are not Unified for Each of Large Groups 81

FIG. 12 is an illustrative diagram of the motion-image image capturingfunction B when mutually different frame rates are set in all the largegroups 81. In this example, a frame rate of 60 fps is set for the firstlarge group 811, a frame rate of 50 fps is set for the second largegroup 812, a frame rate of 24 fps is set for the third large group 813,and a frame rate of 25 fps is set for the fourth large group 814.

When the large groups 81 have mutually different frame rates, thecontrol unit 23 records each frame based on the fastest frame rate as astandard. That is, the image information 64 is recorded at apredetermined cycle T2 (16.7 milliseconds) corresponding to 60 fps. Forinstance, at time t11, which is by a predetermined period T2 later thanthe imaging start time t0, the image information 64 is generated basedon imaging signals that are read out from the unit groups 32 belongingto the first large group 811 and stored in the image file 40. At timet11, no imaging signal is read out from the first frames in other largegroups 812, 813, and 814, so that the image information 64 does notinclude such imaging signals. Note that in FIG. 12, a symbol “X”indicates that no imaging signal is read out from a specified unit group32 and the image information 64 does not include such an imaging signal.

At time t12, which is by a predetermined period T2 later than time t11,not only the second (i.e., the second frame) main image capturing of thefirst large group 811 but also the first (i.e., the first frame) mainimage capturing of the second large group 812 (50 fps) has beencompleted. Then, the control unit 23 reads out imaging signals from theunit groups 32 belonging to the first large group 811 and imagingsignals from the unit groups 32 belonging to the second large group 812and records the read out imaging signals in the image file 40. It readsout no imaging signal from the unit groups 32 belonging to the thirdlarge group 813 and the unit groups 32 belonging to the fourth largegroup 814, so that it records no imaging signal in the image file 40.

As described above, when the large groups 81 have mutually differentframe rates, a part of the image information 64 may sometimes be missing(invalid). The control unit 23 indicates that no imaging signal thatcorresponds to the specified unit group 32 is included in the imageinformation 64 based on the mask information 62 b that is recorded foreach frame. Specific structure of the mask information 62 b will bedescribed hereinbelow.

FIG. 13 is a diagram schematically showing the structure of the imagefile 40 that is generated upon image capturing by using the motion-imageimage capturing function B. Hereafter, differences of the motion-imageimage capturing function B from the motion-image image capturingfunction A as shown in FIG. 7 and the still-image image capturingfunction B as shown in FIG. 10 are described in detail.

The distinction information 60 indicates that the image file 40 isgenerated by using the motion-image image capturing function B. Theimaging condition information 61 is information as to which uses theunit groups 32 have. The imaging condition information 61 in themotion-image image capturing function B corresponds to informationobtained by adding frame rate to the imaging condition information 61 inthe still-image image capturing function B. That is, the imagingcondition information 61 is information that indicates that upongenerating the image file 40, the unit groups 32 have, for instance,four kinds of uses, i.e., a use of “configuring the first imageinformation 641 which is a motion-image at 60 fps”, a use of“configuring the second image information 642, which is a motion-imageat 50 fps”, a use of “configuring the third image information 643, whichis a motion-image at 24 fps”, and a use of “configuring the fourth imageinformation 644, which is a motion-image at 25 fps” and that representsunique numbers allotted to these uses. For instance, the numbers 1 to 4are allotted to the uses of “configuring the first to the fourth piecesof image information 641 to 644”, respectively.

The mask information 62 a in the motion-image image capturing function Bis information that represents respective uses of the unit groups 32 inthe same manner as that in the still-image image capturing function B.That is, the mask information 62 a is “information expressed in the formof a two-dimensional map generated by plotting numbers allotted to theimaging condition information 61 in accordance with the positions of therespective unit groups 32”. For instance, when the number “1” is presentat the coordinate (3, 5) of the mask information 62 a, it is determinedthat the unit group 32 at the coordinate (3, 5) belongs to the firstlarge group 811, that is, it constitutes the first image information641.

The configuration of the data section 42 is the same as the motion-imageimage capturing function A. That is, in the data section 42, the block70 of one frame quota is stored for each frame. One block 70 includesmask information 62 b, image information 64, a Tv value map 65, a Svvalue map 66, a By value map 67, and Av value information 68.Furthermore, in the data section 42, audio information 71 together withthe block 70 for each frame is stored.

It is sometimes the case that in the mask information 62 b, not only thenumber identified based on the imaging condition information 61described above (for instance, 1 to 4) but also the number “0” may bestored. The number “0” indicates that the unit group 32 is not used inimaging in the corresponding frame (i.e., upon imaging no imaging signalis read out). As described above, it is sometimes the case that whenimaging a plurality of motion-images having frame rates differing fromeach other, no imaging signal that corresponds to a specific unit group32 is stored in the image information 64 of some frame. In such a case,the control unit 23 sets the numerical value of the mask information 62that corresponds to the specific unit group 32 to “0”. Here, in the unitgroup 32 the numerical value of the mask information 62 b is set to “0”,no valid values are recorded for information other than the imageinformation 64, i.e., the Tv value in the Tv value map 65, the Sv valuein the Sv value map 66, and the Sv value in the By value map 67.

Note that in the unit group 32 for which the numerical value of the maskinformation 62 b is set to “0”, a configuration may be adopted in whichthe imaging signal in a preceding frame of the unit group 32 is recordedin the image information 64. Also, the values of a preceding frame maybe recorded regarding the Tv value in the Tv value map 65, the Sv valuein the Sv value map 66, and the Sv value in the By value map 67.

As described above, the control unit 23 records in the memory card 25the image file 40 in which the image information 64 generated by theimage sensor 22 for which imaging conditions can be set for each of theunit groups 32 is correlated with data regarding the imaging conditionsfor each of the unit groups 32 (the imaging condition information 61,the mask information 62, the Tv value map 65, the Sv value map 66, andthe By value map 67, etc.) by performing image capturing by using themotion-image image capturing function B.

(5) Mixed Image Capturing Function (Motion-Image and Still-Image)

Mixed image capturing function is a function obtained by combining thestill-image image capturing function B and the motion-image imagecapturing function B, which allows simultaneous image capturing of astill-image and a motion-image relating to the same subject undermutually different imaging conditions by a single imaging operation.

In the mixed image capturing function, the control unit 23 furtherclassifies a plurality of unit groups 32 that is arranged in atwo-dimensional array into a plurality of large groups 81 in a mannersimilar to those of the still-image image capturing function B and themotion-image image capturing function B. The control unit 23 performsmotion-image image capturing for some of the large groups 81 in the samemanner as that of the motion-image image capturing function B. Thecontrol unit 23 performs still-image image capturing in the same manneras that of the still-image image capturing function B during itsmotion-image image capturing by using the other large groups 81. Thisstill-image image capturing may be performed, for instance, at aconstant cycle repeatedly (automatic image capturing) or may beperformed in response to a specified actuation by the user (manual imagecapturing).

FIG. 14 is an illustrative diagram for illustrating the mixed imagecapturing function. Here, four large groups 811 to 814 are assumed to bepresent. Among them, 60 fps motion-image image capturing is performedfor the first large group 811, 50 fps motion-image image capturing isperformed for the second large group 812, and still-image imagecapturing is performed in the third and fourth large groups 813, 814.

The control unit 23 records each frame based on the fastest frame rate(for instance, 60 fps) as a standard similarly to the motion-image imagecapturing function B. While the still-image image capturing is notperformed, always no imaging signal is read out from the unit groups 32belonging to the third and fourth large groups 813, 814. That is, theimage information 64 that is recorded frame by frame does not containimaging signals of the unit groups 32 belonging to the third and fourthlarge groups 813, 814 that correspond to still-images. When the controlunit 23 performs still-image image capturing, it causes, at timing atwhich still-image image capturing is completed (i.e., at timing at whichimaging signals are read out from the unit groups 32 that belong to thethird and fourth large groups 813, 814), the image information 64 thatcorresponds to a frame immediately after the completion of thestill-image image capturing to contain the imaging signals that havebeen read out as a result of that still-image image capturing.

FIG. 15 is a diagram schematically showing the structure of the imagefile 40 that is generated when imaging is performed by using a mixedimage capturing function. Hereafter, differences of the mixed imagecapturing function from the motion-image image capturing function B asshown in FIG. 13 are described in detail.

The distinction information 60 indicates that the image file 40 isgenerated by using the mixed image capturing function. The imagingcondition information 61 is information that indicates what uses theunit groups 32 have. In the case of the mixed image capturing function,the imaging condition information 61 is information that indicates that,for instance, upon generating the image file 40, the unit groups 32 havefour kinds of uses, i.e., a use of “configuring first image information641, which is a motion-image of 60 fps”, a use of “configuring secondimage information 642, which is a motion-image of 30 fps”, a use of“configuring third image information 643, which is a still-image”, and ause of “configuring fourth image information 644, which is astill-image” and that represents unique numbers allotted to these uses,respectively. For instance, numbers 1 to 4 are allotted to the uses of“configuring the first to fourth pieces of image information 641 to644”.

The mask information 62 a in the case of the mixed image capturingfunction is information that indicates respective uses of the unitgroups 32 similarly to the case of the motion-image image capturingfunction B. That is, the mask information 62 a is “information expressedin the form of a two-dimensional map obtained by plotting the numbersallotted to the imaging condition information 61 in accordance with thepositions of the unit groups 32”. For instance, when the number of “1”is present at the coordinate (3, 5) of the mask information 62 a, theunit group 32 at the coordinate (3, 5) belongs to the first large group811, that is, constitutes the first image information 641.

In the case of the mixed image capturing function, the header section 41additionally contains an index section 73. In the index section 73 isrecorded index information 74 that indicates which block 70 among aplurality of blocks 70 (corresponding to a plurality of frames,respectively) has stored therein a still-image. The index information 74includes, for instance, one or a plurality of pieces of information(corresponding to the number of times of still-image image capturing)such as information “third image information 643 contained in the fifthframe image information 64 includes a still-image”. The index section 73is provided so that a still-image can be quickly searched from aplurality of blocks 70.

Note that the index information 74 may be information other than thatidentifies the recording position of the still-image based on the numberof frames. For instance, the recording position of the still-image canbe identified based on the reproduction time of the motion-image. Inthis case, the index information 74 is, for instance, informationindicating that “the third image information 643 in the imageinformation 64 at time of 3 minutes 15 seconds contains a still-image”.

The control unit 23 adds the frame number or the time of still-imageimage capturing to the index section 73 as the index information 74 eachtime the still-image image capturing is performed while image capturingis being performed by using the mixed image capturing function. Notethat the control unit 23 may be configured to store the index section 73in the DRAM 27 temporarily and transfer the information in the DRAM 27to the index section 73 of the image file 40 in the memory card 25 whenthe mixed image capturing function is terminated instead of directlyadding the index information 74 to the index section 73 of the imagefile 40 within the memory card 25.

The configuration of the data section 42 is the same as that in the caseof the motion-image image capturing function B. That is, in the datasection 42, a block 70 for one frame quota is stored for each frame inthe order of image capturing. A single block 70 is constituted by themask information 62, the image information 64, the Sv value map 66, theTv value map 65, the By value map 67, and the Av value information 68.In the data section 42, the audio information 71 together with the block70 for each frame is stored.

As described above, the control unit 23 performs image capturing byusing the mixed image capturing function to record in the memory card 25the image file 40 in which the image information 64 that is generated bythe image sensor 22 for which imaging conditions can be set separatelyfor each of the unit groups 32 is correlated with data (the imagingcondition information 61, the mask information 62, the Tv value map 65,the Sv value map 66, and the By value map 67, etc.) relating to theimaging conditions for each of the unit groups 32.

Then, a reproduction process of an image by the control unit 23 will beexplained below. The reproduction process of an image is a process forgenerating an image of a subject from the image files 40 that arerecorded in the memory card 25 by using the above-described varioustypes of image capturing functions. The control unit 23 may forinstance, display the generated image on the liquid crystal monitor 24or may record the generated image in the memory card 25 as a fileseparate from the image file 40.

The control unit 23 opens the image file 40 (FIG. 5, FIG. 7, FIG. 10,FIG. 13, and FIG. 15) and reads out at first the file basic informationsection 43. This enables the offset and size of the mask section 44, thedata section 42, etc. of the image file 40 to be found. Then, thecontrol unit 23 reads out the distinction information 60 from the masksection 44 of the image file 40. As a result, the control unit 23 canrecognize which image capturing function is used for generating theimage file 40. Subsequent processing may differ for different imagecapturing functions. Accordingly, reproduction process of an image isexplained for each of the above-mentioned image capturing functions.

(1) Still-Image Image Capturing Function A (Single Still-Image)

When the control unit 23 recognizes that the image file 40 is a filethat is generated by using the still-image image capturing function A asshown in FIG. 5, it reads out the imaging condition information 61 andthe mask information 62 a from the mask section 44. As a result, thecontrol unit 23 can recognize which range (which unit groups 32) amongthe whole image capture screen is a main subject part or a backgroundpart and change the construction of the image based on the main subjectpart and the background part. For instance, the main subject part issubjected to an edge enhancement process to make the image sharper andthe background part is subjected to an airbrushing or blurring processto enhance the main subject part.

Then, the control unit 23 reads out the image information 64, the Tvvalue map 65, the Sv value map 66, the By value map 67, and the Av valueinformation 68 from the data section 42. Then, the control unit 23executes a so-called development process on the image information 64based on the Tv value map 65, the Sv value map 66, the By value map 67,and the Av value information 68 that are thus read out. When the imageinformation 64 is RAW data, the image processing section 23 executes,for instance, a well-known demosaicing process on the image information64 having no color information to generate an image having colorinformation. Also, the control unit 23 performs image processing such asadjustment of color, brightness, etc., noise reduction, etc. based onthe Sv value map 66, etc. For instance, unit groups 32 having larger Svvalues (higher sensitivities) tend to have more noises than other unitgroups 32. Accordingly, the control unit 23 reduces noises moreintensely when Sv values are larger. The control unit 23 can, forinstance, display the image thus generated on the liquid crystal monitor24 or record it in the memory card 25.

As described above, for reproducing the image file 40 generated by usingthe still-image image capturing function A, the control unit 23 readsout the imaging condition information 61 and the mask information 62 arecorded in the mask section 44 prior to reading out the informationrecorded in the data section 42, such as image information 64, etc. Thiscan minimize the seek time that will be generated upon reproductionprocess since the mask section 44 is recorded before the data section42.

Note that as described above, in the data section 42 is stored the maskinformation 62 b that is the same as the mask information 62 a stored inthe header section 41. Accordingly, the control unit 23 may beconfigured to read out the mask information 62 b instead of the maskinformation 62 a from the data section 42.

(2) Motion-Image Image Capturing Function A (Single Motion-Image)

When the control unit 23 recognizes that the image file 40 is a filegenerated by using the motion-image image capturing function A as shownin FIG. 7, it reads out the mask information 62 a from the mask section44. The control unit 23 determines which range (which unit groups 32)among the whole image capture screen is a main subject part or abackground part. Then, the control unit 23 reads out the imagingcondition information 61 from the mask section 44. As a result, thecontrol unit 23 can recognize frame rates of the main subject part andbackground part. Then, the control unit 23 reads out the imageinformation 64, the data section 42, the Tv value map 65, the Sv valuemap 66, the By value map 67, and the Av value information 68 from a heador first block 70 of the data section 42 and subsequent blocks 70 inorder and generates each frame that constitutes a motion-image basedthereon.

Upon generating each of the frames, the control unit 23 reads out fromthe block 70 at first the mask information 62 b. Then, it determineswhich range (which unit groups 32) in the frame is a main subject partor a background part. Thereafter, the control unit 23 executes differentimage processes on the main subject part and on the background part asexplained with respect to the still-image image capturing function A.The control unit 23, for instance, displays the motion-image constitutedby the frames that are generated as described above on the liquidcrystal monitor 24 or records it in the memory card 25.

As described above, for reproducing the image file 40 that is generatedby using the motion-image image capturing function A, the control unit23 reads out the mask information 62 b prior to the information recordedin the block 70, such as image information 64, etc. Since the maskinformation 62 b is recorded before the image information 64, etc., theseek time that will occur upon reproduction process can be minimized.

Note that since the mask information 62 b in the head block of the datasection 42 is the same information as the mask information 62 a recordedin the mask section 44, the control unit 23 may be configured so as notto read out the mask information 62 a from the mask section 44.

(3) Still-Image Image Capturing Function B (a Plurality of Still-Images)

When the control unit 23 recognizes that the image file 40 is a filethat is generated by using the still-image image capturing function B asshown in FIG. 10, it reads out the imaging condition information 61 andthe mask information 62 a from the mask section 44. This allows thecontrol unit 23 to determine how many kinds of still-images are capturedsimultaneously and which unit groups 32 constitutes any one ofstill-images. That is, it determines how many large groups 81 arepresent and to which large group each of the unit groups 32 belongs.

Then, the control unit 23 reads out the image information 64, the Tvvalue map 65, the Sv value map 66, the By value map 67, and the Av valueinformation 68 from the data section 42. Then, the control unit 23executes a so-called development process on the image information 64 foreach large group 81 separately based on the Tv value map 65, the Svvalue map 66, the By value map 67, and the Av value information 68 togenerate a still-image. As a result, a plurality of still-images (forinstance, four still-images) is generated. The control unit 23, forinstance, displays the images generated as described above on the liquidcrystal monitor 24 or records them in the memory card 25.

As described above, for reproducing the image file 40 that is generatedby using the still-image image capturing function B, the control unit 23reads out the imaging condition information 61 and the mask information62 a recorded in the mask section 44 prior to the information recordedin the data section 42, such as the image information 64, etc. Since themask section 44 is recorded before the data section 42, the seek timethat will occur upon reproduction process can be minimized.

Note that as described above, the mask information 62 b which is thesame information as the mask information 62 a stored in the headersection 41 is stored in the data section 42. Accordingly, the maskinformation 62 b may be read out from the data section 42 instead of themask information 62 a.

(4) Motion-Image Image Capturing Function B (a Plurality ofMotion-Images)

When the control unit 23 recognizes that the image file 40 is a filethat is generated by using the motion-image image capturing function Bas shown in FIG. 13, it reads out the mask information 62 a and theimaging condition information 61 from the mask section 44. This allowsthe control unit 23 to determine how many kinds of motion-images arecaptured simultaneously, which unit groups 32 constitute any one ofmotion-images, and the frame rate of each motion-image. That is, itdetermines how many large groups 81 are present, which large group 81each of the unit groups 32 belongs to, and the frame rate at which eachof the large groups 81 is imaged. Then, the control unit 23 reads outthe image information 64, the Tv value map 65, the Sv value map 66, theBy value map 67, and the Av value information 68 from the head andsubsequent blocks 70 in the data section 42 in order and generates eachof the frame that constitute each of the motion-images based thereon.

For generating each of the frames, the control unit 23 at first readsout the mask information 62 b from the block 70. Then the control unit23 determines which large group 81 the pixel signal contained in theimage information 64 in the block 70 corresponds to. Thereafter, thecontrol unit 23 generates a frame that corresponds to each of the largegroups 81. However, it generates no frame for a large group 81 if nopixel signal corresponding to this large group 81 is contained in theimage information 64 in the block 70. The control unit 23, for instance,displays the motion-image constituted by the frames that are generatedas described above on the liquid crystal monitor 24 or records it in thememory card 25.

As described above, for reproducing the image file 40 that is generatedby using the motion-image image capturing function B, the control unit23 reads out the mask information 62 a, 62 b prior to the informationrecorded in the block 70, such as the image information 64, etc. Sincethe mask information 62 a, 62 b is recorded before the image information64, etc, the seek time that will occur upon the reproduction process canbe minimized.

Note that since the mask information 62 b in the head block in the datasection 42 is the same information as the mask information 62 a recordedin the mask section 44, the control unit 23 may be configured so as notto read out mask the information 62 a from the mask section 44.

(5) Mixed Image Capturing Function (Motion-Image and Still-Image)

When the control unit 23 recognizes that the image file 40 is a filethat is generated by using the mixed image capturing function as shownin FIG. 15, it reads out the mask information 62 a and the imagingcondition information 61 from the mask section 44. This allows thecontrol unit 23 to determine how many kinds of motion-images and howmany kinds of still-images are captured simultaneously, which unitgroups 32 constitutes any one of still-images and any one ofmotion-images, and the frame rate of each motion-image. That is, thecontrol unit 23 determines how many large groups 81 are present, whethereach of the large groups 81 is a still-image or a motion-image, theframe rate of each of the unit groups 32 if the large group 81 is amotion-image, and which large group 81 any one of the unit groups 32belongs to. Then, the control unit 23 reads the image information 64,the Tv value map 65, the Sv value map 66, the By value map 67, and theAv value information 68 from the head and subsequent blocks 70 in thedata section 42 in order and generates, based thereon, each of theframes that constitute each of the motion-images and each of thestill-images.

For generating each of the frames of a motion-image or a still-image,the control unit 23 at first reads out the mask information 62 b fromthe block 70. Then, it determines which large group 81 the pixel signalcontained in the image information 64 in the block 70 corresponds to.Thereafter, the control unit 23 generates a frame or a still-image thatcorresponds to each of the large groups 81. However, it generatesneither frame nor still-image for a large group 81 if no pixel signalcorresponding to this large group 81 is contained in their imageinformation 64 in the block 70. The control unit 23, for instance,displays the motion-image that is constituted by the frames or thestill-image generated as described above on the liquid crystal monitor24 or records it in the memory card 25.

As described above, for reproducing the image file 40 that is generatedby using the mixed image capturing function, the control unit 23 readsout the mask information 62 a, 62 b prior to the information recorded inthe block 70, such as the image information 64, etc. Since the maskinformation 62 a, 62 b is recorded before the image information 64, etc,the seek time that will occur upon the reproduction process can beminimized.

Note that since the mask information 62 b in the head block in the datasection 42 is the same information as the mask information 62 a recordedin the mask section 44, the control unit 23 may be configured to readout no mask information 62 a from the mask section 44.

The reproduction process of images is a process by which an image of asubject is generated based on the image file 40 that is recorded in thememory card 25 by one of the above-mentioned various types of imagecapturing functions. However, it may be a process by which a still-imageand/or a motion-image is generated based on the image file 40 before itcan be recorded in the memory card 25. The control unit 23 may beconfigured to perform a compression process after the still-image and/ormotion-image is generated.

Note that a configuration may be adopted in which an electronicapparatus that is different from the image capturing device 10(hereafter, referred to as a reproduction device) executes theabove-mentioned reproduction process. For instance, a configuration maybe adopted in which when the memory card 25 is removed from the imagecapturing device 10 and attached to a reproduction device in a personalcomputer (PC), the reproduction device reads out the image file 40 fromthe memory card 25 and executes the above-mentioned reproduction processto reproduce an image. Also, a configuration may be adopted in whichdata communication, such as wireless communication, is performed betweenthe image capturing device 10 and the reproduction device to transferthe image information 64, etc.

The image capturing device according to the above-mentioned firstembodiment provides the following operations and advantageous effects.

(1) The image sensor 22 has a plurality of unit groups 32 (imagingcapture regions) so that imaging condition can be set for each of theunit groups 32 separately. The control unit 23 records the imageinformation 64 (image data) generated by the image sensor 22 incorrelation with the data relating to imaging conditions, such as theimaging condition information 61, the mask information 62, the Tv valuemap 65, the Sv value map 66, the By value map 67, etc. (imagingcondition data) for each of the unit groups 32. This configuration makesit possible to know what imaging conditions have been applied to each ofthe pixels at the time of reproducing the image file 40, which is theresult of the image capturing, or at some other timings. As a result,the image capturing device 10 which is user-friendly can be provided.

(2) The information relating to imaging conditions that is recorded incorrelation with the image information 64 includes, for instance,information relating exposure upon capturing an image of a subject bythe image sensor 22 and information relating to brightness of thesubject whose image is captured by the image sensor 22. Specifically,the information relating to imaging conditions includes the By value map67, which is information relating to the luminance of the subject whoseimage is captured by the image sensor 22, the Tv value map 65, which isaccumulation time in which charges are accumulated by a photoelectricconversion unit not shown in the figures, the Sv value map 66, which isan amplification factor by an amplifying unit not shown in the figures,etc. Each of these pieces of information can be said to be informationrelating to the imaging operation of the image sensor 22. Thisconfiguration enables more suitable image processing to be performedupon reproduction of the image file 40.

(3) The control unit 23 is configured to record information relating tothe imaging conditions, which varies upon each image capturing, incorrelation with the image information 64. This configuration enablessuitable information to be added to each image file 40 and more suitableimage processing to be performed upon reproduction.

(4) The control unit 23 is configured to record a plurality of pieces ofinformation relating to imaging conditions that correspond to the imageinformation 64, respectively, in a single image file 40 in chronologicalorder. This configuration enables, for instance, when a motion-image isrecorded in the image file 40, image processing based on these pieces ofinformation to be performed with ease.

(5) The control unit 23 is configured to record, for the image file 40that has the header section 41 and the data section 42 in which theimage information 64 is recorded (image data section), informationrelating to imaging conditions in at least one of the header section 41and the data section 42. By this configuration, it is possible to knowwhat imaging conditions have been applied to each of the pixels, forinstance, upon reproduction of the image file 40.

(6) The control unit 23 is configured to record the imaging conditioninformation 61 and the mask information 62 relating to uses for aplurality of unit groups 32, respectively, in correlation with the imageinformation 64. With this configuration, it is possible to know whatimaging conditions have been applied to each of the pixels, forinstance, upon reproduction of the image file 40.

(7) The mask information 62 contains dynamic information, which varieswith time. Specifically, the mask information 62 contains informationindicating whether the image information 64 includes a pixel valuecorresponding to a pixel signal that is read out from the imaging pixel31 belonging to the unit group 32 or information indicating which one ofa plurality of mutually different groups each of a plurality of unitgroups 32 has been classified into. This enables image processing usingdynamic information to be performed, for instance, upon reproducing theimage file 40.

(8) The mask information 62 contains static information, which does notvary with time. Specifically, the mask information 62 containsinformation indicating respective functions of the plurality of unitgroups 32. Furthermore, the mask information 62 a contains informationindicating which one of a plurality of mutually different groups each ofthe plurality of unit groups 32 has originally been classified into atthe beginning of image capturing. This enables image processing usingstatic information to be performed, for instance, upon reproducing theimage file 40.

(9) The control unit 23 is configured to record, in a single image file40, a plurality of pieces of the mask information 62 b corresponding tothe plurality of pieces of image information 64 in chronological order.This configuration enables chronological tracking of imaging conditions,for instance, upon reproducing the image file 40.

(10) The control unit 23 is configured to record, for the image file 40that has the header section 41 and the data section 42 in which theimage information 64 is recorded (image data section), the maskinformation 62 in at least one of the header section 41 and the datasection 42. By this configuration, it is possible to know what imagingconditions have been applied to each of the pixels, for instance, uponreproduction of the image file 40.

(11) The plurality of unit groups 32 includes a unit group 32 whoseimage is captured at a first frame rate and a unit group 32 whose imageis captured at a second frame rate, which is lower than the first framerate. The control unit 23 records a plurality of pieces of imageinformation 64 based on the first frame rate. This enables recording theinformation relating to all the frames in every detail without fail.

(12) The control unit 23 is configured to record audio information 71(audio data) corresponding to imaging periods of a plurality of piecesof image information 64 in correlation with the plurality of pieces ofimage information 64. This configuration enables reproduction of motionimage including sound.

(13) The control unit 23 is configured to record at least one ofinformation relating to an imaging pattern of the image information 64,information relating to a method of storing the image information 64,and information relating to imaging conditions for each unit group 32 inthe image file 40 that includes two blocks, i.e., the header section 41and the data section 42, more particularly in the header section 41. Bythis construction, it is possible to know what imaging conditions havebeen applied to each of the pixels, for instance, upon reproducing theimage file 40.

Second Embodiment

An image capturing device according to a second embodiment has aconfiguration similar to that of the image capturing device 10 accordingto the first embodiment. However, the methods for recording the imagefile 40 according to the still-image image capturing function B, themotion-image image capturing function B, and the mixed image capturingfunction are different from those in the first embodiment. Hereafter,this feature is described in detail.

As described above, the still-image image capturing function B, themotion-image image capturing function B, and the mixed image capturingfunction are each a function by which a plurality of still-images and/ora plurality of motion-images relating to the same subject are capturedsimultaneously by a single image capturing operation. In thisembodiment, the control unit 23 is configured so as to divide theplurality of still-images and/or the plurality of motion-images thuscaptured into a plurality of image files 40 and record them separatelyinstead of recording them into a single image file 40. On this occasion,the control unit 23 records the separately recorded image files 40 incorrelation with each other. As a result, although the divided files arerecorded separately for convenience's sake, the information indicatingthat the plurality of image files 40 have been acquired by a singleimaging operation is not impaired, similarly to the first embodiment. Inother words, the plurality of image files 40 can be handled later underrecognition that they have been acquired by a single image capturingoperation similarly to the case in the first embodiment.

FIG. 16 is a diagram schematically showing a directory structure of thememory card 25. A root directory 90 of the memory card 25 has a DCIMdirectory 91 a. The DCIM directory 91 a has therein a subdirectory 91 bfor storing images. For each single image capturing operation by usingthe still-image image capturing function B, the motion-image imagecapturing function B, or the mixed image capturing function, the controlunit 23 generates a single imaging set directory 92 in this subdirectory91 b. That is, one imaging set directory 92 corresponds to one imagecapturing operation.

In the imaging set directory 92, one administration data file 93 andsubdirectories 94 for respective uses of the unit group 32 aregenerated. For instance, if a unit groups 32 have four uses, foursubdirectories 94 are generated. For each of the subdirectories 94, atleast one image file 40 corresponding to a use of the unit group 32 isgenerated. For instance, if the use of the unit group 32 is themotion-image image capturing, only one motion-image file 401 is recordedin the subdirectory 94 corresponding to this use. On the other hand, ifthe use of the unit group 32 is the still-image image capturing, astill-image file 402 is recorded in the subdirectory 94 a number oftimes that corresponds to the number of times of image capturingoperation. Note that in the case of the still-image image capturingfunction B, only one still-image file 402 is recorded for each of theuses by a single image capturing operation, so that one still-image file402 is recorded in each subdirectory 94.

FIG. 17(a) is a diagram schematically showing the structure of theadministration data file 93. The administration data file 93 is a filein which information that correlates the image files 40 recorded in thesubdirectories 94 with each other and includes a file basic informationsection 43, a mask section 44, an index section 73, and an imaginginformation section 45. The file basic information section 43, the masksection 44, and the imaging information section 45 are the same as thosesections having the same names in the image file 40 that are explainedin FIG. 15, etc. In the index section 73, layout information 96 thatindicates which use of the unit group 32 each of the subdirectories 94corresponds to, is recorded.

FIG. 17(b) is a diagram schematically showing the structure of thestill-image file 402 that is recorded in the subdirectory 94. In thestill-image file 402 are recorded mask information 62 b, imageinformation 64, a Tv value map 65, a Sv value map 66, a By value map 67,and Av value information 68. Since the Av value information 68 issimilar to that explained in FIG. 10 and explanation thereof is omitted.

The mask information 62 b, the image information 64, the Tv value map65, the Sv value map 66, and the By value map 67 are each informationthat is obtained by extracting only values corresponding to one of thelarge groups 81 from the information having the same name as explainedin FIG. 10 and arranging the extracted values in a two-dimensionalarray. For instance, in the image file 40 that is explained in FIG. 10,the mask information 62 b is “information that contains numbers allottedto imaging condition information 61 expressed in the form of atwo-dimensional map in accordance with the positions of the unit groups32”. The number of values contained in the mask information 62 b is thesame as the number of the unit groups 32. In contrast, the maskinformation 62 b in the still-image file 402 is information that isprepared by extracting from all the values only those values thatcorrespond to the large group 81, which in turn corresponds to thissubdirectory 94, and expressing the extracted values in the form of atwo-dimensional map. The image information 64, the Tv value map 65, theSv value map 66, and the By value map 67 are similarly prepared and onestill-image file 402 contains only those values corresponding to onelarge group 81.

FIG. 18 is a diagram schematically showing the structure of themotion-image file 401 that is recorded in the subdirectory 94. In themotion-image file 401 is stored one frame quota block 70 for each of theframes in order of image capturing. A single block 70 includes maskinformation 62 b, image information 64, ae Tv value map 65, a Sv valuemap 66, a By value map 67, and Av value information 68. The motion-imagefile 401 has stored therein the block 70 for each frame together withaudio information 71. Since the Av value information 68 is similar tothat explained in FIG. 13 and explanation thereof is omitted.

The mask information 62 b, the image information 64, the Tv value map65, the Sv value map 66, and the By value map 67 are each informationthat is obtained by extracting only values corresponding to one largegroup 81 from the information having the same name as explained in FIG.13 and arranging the extracted values in a two-dimensional array. Thisis the same as in the case of the above-mentioned still image file 402and explanation thereof is omitted.

As described above, the control unit 23 records, in the memory card 25,the image information 64 that is generated by the image sensor 22 forwhich imaging conditions can be set for each of the unit groups 32separately in correlation with data relating to the imaging conditions(the imaging condition information 61, the mask information 62, the Tvvalue map 65, the Sv value map 66, the By value map 67, etc.) for eachof the unit groups 32. Differently from the first embodiment, in thisembodiment, the administration data file 93, the motion image file 401,and the still image file 402 are correlated with each other via thelayout information 96 in the administration data file 93 although theydo not form a single image file 40.

The image capturing device according to the second embodiment providesthe similar operation and advantageous effects as those of the imagecapturing device according to the first embodiment.

Variations as described below are also included within the scope of thepresent invention and one or more variation examples may be combinedwith the above-mentioned embodiments.

Variation Example 1

In the first embodiment, the first image information 641 and the secondimage information 642 have been explained that they are generated whenreproducing the image file 40. However, they may be recorded in theimage file 40 in advance. In other words, the motion-image and thestill-image, which are recorded in different subdirectories 94 asdifferent files for each of the large groups 81 separately in the secondembodiment, may be recorded in a single image file 40. In this case,data for one frame quota that is recorded in the image file 40corresponds to one large group 81.

For instance, a case may be conceived in which two motion-images (firstmotion-image and second motion-image) that are recorded in two files,separately, according to the second embodiment are recorded in a singleimage file 40. In this case, starting from the head of the data section42, data relating to the first frame, second frame, third frame, . . . ,respectively, of the first motion-image are recorded in chronologicalorder, and subsequently data relating to the first frame, second frame,third frame, . . . , respectively, of the second motion-image arerecorded in chronological order. In this manner, the load of thereproduction process can be reduced.

As a recording method other than is described above, a recording methodmay be adopted in which data relating to each frame of the firstmotion-image and data relating to each frame of the second motion-imageare recorded in chronological order with respect to each of the frames.That is, each of the frames of each of two motion-images may be recordedin the form of an array in chronological order of image capturing, suchas an array of “the first frame of the first motion-image, the firstframe of the second motion-image, the second frame of the firstmotion-image . . . ”. This enables the recording process to be performedat a reduced load.

Variation Example 2

In the explanation of the first embodiment, it has been stated that inthe data section 42 of the image file 40 generated by using themotion-image image capturing function B and the mixed image capturingfunction are recorded the image information 64 and various types of mapinformation according to the array of the unit groups 32 in the imagesensor 22. Recording may be performed based on an array different fromthe array of the unit groups 32. Hereafter, this is described in detail.

FIG. 19 is an illustrative diagram for illustrating Variation Example 2.Here, the unit groups 32 are classified into four large groups 81 in thesame manner as in FIG. 8(b). However, the image information 64 that willbe generated by the control unit 23 afterward is not formed by arrangingimaging signals according to the array of the unit groups 32.Specifically, the image information 64 is generated by aggregatingimaging signals for each large group 81 and then interlinks them. Forinstance, when the image information 64 is separated into four regionsin a 2×2 construction, imaging signals from the unit groups 32 belongingto the first large group 81 are aggregated in the upper left region. Inthe lower left region, imaging signals from the unit groups 32 belongingto the second large group 81 are aggregated. Further, in the upper rightregion, imaging signals from the unit groups 32 belonging to the thirdlarge group 81 are aggregated. In the lower right region, imagingsignals from the unit groups 32 belonging to the fourth large group 81are aggregated.

Note that when changing the array of imaging signals in the imageinformation 64 as described above, it is necessary to change the arraysof the Tv value map 65, the Sv value map 66, the mask information 62,etc. in accordance with that array.

The array of the image information 64 may be changed by a method otherthan this. That is, as long as the array in the image information 64 andthe array in other information relating to other imaging conditions(mask information 62, etc.) correspond to each other in the image file40, any types of arrays may be employed.

Variation Example 3

In the case of the motion-image image capturing function B and the mixedimage capturing function, the use of the unit group 32 may be changedframe by frame. For instance, it is configured such that as shown inFIG. 20, the unit groups 32 are classified into the first to fourthlarge groups 81 for odd number frames so that the image information 64containing four pieces of the image information 641, 642, 643, 644 withdifferent imaging conditions can be obtained. For even number frames,the unit groups 32 are classified into the fifth large group 81 only sothat only the single image information 64 can be obtained. That is, aconfiguration may be adopted in which a plurality of images havingdifferent imaging conditions with a relatively small number of pixelsand a single image with a relatively large number of pixels are capturedin a time shared fashion. Variation Example 3 may be applied toVariation Example 1 or to Variation Example 2 described above.

Variation Example 4

In the case of the motion-image image capturing function B and the mixedimage capturing function, a configuration may be adopted in which asingle unit group 32 has a plurality of uses. For instance, aconfiguration may be adopted in which as shown in FIG. 21, the unitgroups 32 are classified into the first to fourth large groups 81,respectively and also all the unit groups 32 are classified into thefifth large group 81. In this case, when reproduction (development,etc.) of the image file 40 is performed according to the formerclassification, the image information 64 that contain the four pieces ofthe image information 641, 642, 643, 644 can be obtained. On the otherhand, when reproduction (development, etc.) of the image file 40 isperformed according to the latter classification, the single imageinformation 64 with a larger number of pixels can be obtained.

Variation Example 5

In the explanation of the still-image image capturing function B, it hasbeen stated that the unit group 32, for which the number “0” is allottedon the mask information 62, is not used in imaging and the imageinformation 64 recorded in the data section 42 contains no informationrelating to that unit group 32. Also in the case of the still-imageimage capturing function A and the motion-image image capturing functionA, a configuration may be adopted in which the number “0” has the samemeaning as that in the case of the still-image image capturing functionB.

Also, a configuration may be adopted in which the number “0” in the maskinformation 62 in the header section 41 indicates that the unit group32, for which the number “0” is allotted, is not used in imagecapturing. For instance, when, in the case of the still-image imagecapturing function B and the motion-image image capturing function B,the whole image capture screen is separated into sets of four unitgroups 32 in a 2×2 configuration, different uses are allotted todifferent unit groups 32, respectively, and if the number of the unitgroups 32 in the vertical direction (row number) is odd, one row is leftas the balance. In such a case, a configuration may be adopted in whichthe one row left as the balance is not used in imaging and the number of“0” is allotted to the one row in the mask information 62 that isrecorded in the header section 41.

Note that the number of “0” is only an example and other numbers may beused similarly to the above-mentioned number “0”.

Variation Example 6

The structure of the image file 40 may be different from those of theabove-mentioned embodiments. The information relating to the imagingconditions that is recorded in the image file 40 may be different fromthe information that is explained in the first embodiment, etc. Forinstance, recording of some information such as the Sv value map 66 orthe like may be omitted. On the contrary, information other than theabove-mentioned one may further be added. Furthermore, the mode ofrecording may be different from those in the above-mentionedembodiments. For instance, the Av value information 68 may be recordedas an Av value map generated by arranging Av values in a two-dimensionalarray for each of the unit groups 32 in the same manner as that in Tvvalues, Sv values, etc.

Variation Example 7

In each of the above-mentioned embodiments, the image capturing device,which is a single electronic apparatus that includes the image sensor 22and the control unit 23, has been explained. However, the presentinvention is not limited to these embodiments. For instance, the presentinvention may be applied to an electronic apparatus that controls theimage sensor 22 provided as an external device. Hereafter, a mode, inwhich an image capturing unit 1001 provided with the image sensor 22 iscontrolled through an external apparatus, is explained in detail.

FIG. 22 is a block diagram schematically showing a configuration of animage capturing system according to Variation Example 7. The imagecapturing system 1000 shown in FIG. 22 includes the image capturing unit1001 and an electronic apparatus 1002. The image capturing unit 1001includes the image capturing optical system 21 and the image sensor 22that are explained in the first embodiment and further a firstcommunication unit 1003. The electronic apparatus 1002 includes thecontrol unit 23, the liquid crystal monitor 24, the memory card 25, theactuation unit 26, the DRAM 27, the flash memory 28, and the recordingunit 29 that have been explained in the first embodiment and further asecond communication unit 1004. The first communication unit 1003 andthe second communication unit 1004 are capable of performingbidirectional data communication by using, for instance, a well-knownwireless communication technology and an optical communicationtechnology, etc. Also, a configuration may be adopted in which the imagecapturing unit 1001 and the electronic apparatus 1002 performbidirectional data communication via wire-line connection such as cable,etc. to enable bidirectional data communication between the firstcommunication unit 1003 and the second communication unit 1004.

In the image capturing system 1000 according to Variation Example 7, thecontrol unit 23 controls the image sensor 22 by data communicationthrough the second communication unit 1004 and the first communicationunit 1003. For instance, by transmitting and receiving predeterminedcontrol data to and from the image capturing unit 1001, the control unit23 sets imaging conditions that differ for each of the unit groups 32 orreads out an imaging signal from each of the unit groups 32.

As described above, in the image capturing system 1000, control on eachof the unit groups 32 is performed by the control unit 23. Theelectronic apparatus 1002 is provided with no image sensor 22. However,by controlling the image sensor 22 (image capturing unit 1001) that isprovided outside of the electronic apparatus 1002, the same control asthat in the first embodiment can be obtained. That is, the presentinvention can be applied to an electronic apparatus that has no imagesensor 22.

Variation Example 8

To reduce the data amount of the image information 64, the imageinformation 64 may be compressed by a well-known reversible compressiontechnology before it is recorded. The image information 64 may berecorded in the form of difference values with respect to adjacentpixels. For instance, a configuration may be adopted in which at aposition, at which the pixel value (imaging signal) of a specified pixelis recorded, is recorded a difference value between the specified pixeland its left adjacent pixel. Alternatively, a difference value from anaverage pixel value of all the pixels in a predetermined region may berecorded or a difference value from an average pixel value of all thepixels may be recorded.

In the case of motion-images, a configuration in which a differencevalue from the pixel value at the same position as that of a previousframe is recorded enables a further reduction of data amount.Alternatively, a configuration may be adopted in which a pixel value isrecorded only when the pixel value differs from a pixel value of theprevious frame at the same position and no pixel value is recorded whenthe pixel value is the same as that of the previous frame. Thisconfiguration may be applied to the imaging conditions (Sv value, Tvvalue, etc.). For instance, a configuration may be adopted in which whenone frame has the same Sv value as that of a previous frame for a unitgroup 32, that Sv value is not recorded.

Note that if the image information 64 is recorded in the form that isdescribed as above, it is necessary to perform a process for restoringoriginal pixel values from these forms for reproduction (i.e., at thetime of development).

Variation Example 9

In each of the above-mentioned embodiments, the present invention hasbeen explained as has been adopted in an example of a lens integratedtype camera. However, the present invention may be adopted in, forinstance, an interchangeable lens camera. The present invention may beadopted in not only cameras but also electronic apparatuses with acamera, such as a PC, a cellular phone, a smart phone, a tablet, etc.

Note that programs that relate to the above-mentioned embodiments can beprovided as computer readable program products of various forms, e.g.,in the form of recording media or data signals (carrier waves). Theabove-mentioned types of programs can be provided through recordingmedia such as CD-ROM or data signals such as the Internet.

The present invention is not limited to the above-mentioned embodimentsand so far as the features of the present invention are not impaired,other embodiments that are conceivable within the scope of the technicalconcepts of the present invention are encompassed within the scope ofthe present invention.

The disclosure of the following priority application is hereinincorporated by reference:

Japanese Patent Application No. 2014-201951 (filed on Sep. 30, 2014).

REFERENCE SIGNS LIST

10 . . . image capturing device, 21 . . . image capturing opticalsystem, 22 . . . image sensor, 23 . . . control unit, 24 . . . liquidcrystal monitor, 25 . . . memory card, 26 . . . actuation unit, 27 . . .DRAM, 28 . . . flash memory, 29 . . . recording unit

1. An electronic apparatus comprising: an input unit into which image data generated by an image capturing unit is input, the image capturing unit having a first imaging region including a plurality of pixels for capturing an image of a subject under a first imaging condition and a second imaging region including a plurality of pixels for capturing an image of the subject under a second imaging condition different from the first imaging condition, the first imaging region and the second imaging region being arranged in two directions intersecting each other; and a recording control unit configured (i) to record, in a recording unit, first image data generated in the first imaging region continuously without including second image data generated in the second imaging region, and (ii) to record, in the recording unit, the second image data generated in the second imaging region continuously without including the first image data generated in the first imaging region.
 2. The electronic apparatus according to claim 1, wherein: the recording control unit is configured to record the first imaging condition and the second imaging condition in the recording unit.
 3. The electronic apparatus according to claim 2, wherein: the recording control unit is configured to record the first imaging condition and the first image data in association with each other, and to record the second imaging condition and the second image data in association with each other.
 4. The electronic apparatus according to claim 1, wherein: the first image data and the second image data are still-images; and the first imaging condition and the second image condition are imaging conditions for still-images.
 5. The electronic apparatus according to claim 1, wherein: the first image data and the second image data are motion-images; and the first imaging condition and the second image condition are imaging conditions for motion-images.
 6. The electronic apparatus according to claim 1, wherein: the first imaging condition and the second imaging condition contain information relating to exposure for capturing an image of the subject by the image capturing unit.
 7. The electronic apparatus according to claim 1, wherein: the first imaging condition and the second imaging condition include information relating to brightness of the subject whose image is captured by the image capturing unit.
 8. The electronic apparatus according to claim 1, wherein: the first imaging condition and the second imaging condition include information relating to an imaging operation of the image capturing unit.
 9. The electronic apparatus according to claim 1, wherein: the first imaging condition and the second imaging condition include information relating to luminance of the subject whose image is captured by the image capturing unit.
 10. The electronic apparatus according to claim 1, wherein: the first imaging region and the second imaging region each have a photoelectric conversion unit that accumulates a charge generated by photoelectrically converting incident light; and the first imaging condition and the second imaging condition include a time period of accumulation of the charge by the photoelectric conversion unit.
 11. The electronic apparatus according to claim 1, wherein: the first imaging region and the second imaging region each have an amplification unit that amplifies a signal generated from the photoelectrically converted charge; and the first imaging condition and the second imaging condition include an amplification factor of the amplification unit.
 12. A recording medium having stored therein a program that is executable by a computer, the program comprising: an input step in which image data generated by an image capturing unit is input, the image capturing unit having a first imaging region including a plurality of pixels for capturing an image of a subject under a first imaging condition and a second imaging region including a plurality of pixels for capturing an image of the subject under a second imaging condition different from the first imaging condition, the first imaging region and the second imaging region being arranged in two directions intersecting each other; and a recording control step in which (i) first image data generated in the first imaging region is recorded continuously without including second image data generated in the second imaging region, and (ii) the second image data generated in the second imaging region is recorded continuously without including the first image data generated in the first imaging region. 